[ 507.661384] env[63014]: INFO neutron.common.config [-] Logging enabled! [ 507.661640] env[63014]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev17 [ 507.661831] env[63014]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=63014) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 507.662138] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 507.662238] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 507.663073] env[63014]: WARNING oslo_policy.policy [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 507.663292] env[63014]: WARNING oslo_policy.policy [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 507.664747] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] VMware NSXv3 Agent initialized successfully. [ 507.665118] env[63014]: DEBUG oslo_concurrency.lockutils [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] Acquiring lock "singleton_lock" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 507.665261] env[63014]: DEBUG oslo_concurrency.lockutils [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] Acquired lock "singleton_lock" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 507.665464] env[63014]: DEBUG oslo_concurrency.lockutils [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] Releasing lock "singleton_lock" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 507.665750] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] Full set of CONF: {{(pid=63014) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 507.665961] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ******************************************************************************** {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 507.666093] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] Configuration options gathered from: {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 507.666329] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 507.666500] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 507.666615] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ================================================================================ {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 507.666786] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] agent_down_time = 75 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.666935] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] allow_automatic_dhcp_failover = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.667092] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] allow_bulk = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.667244] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] api_extensions_path = {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.667390] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] api_paste_config = api-paste.ini {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.667539] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] auth_strategy = keystone {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.667698] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] backdoor_port = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.667778] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] backdoor_socket = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.667897] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] backlog = 4096 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.668052] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] base_mac = fa:16:3e:00:00:00 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.668215] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] bind_host = 0.0.0.0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.668363] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] bind_port = 9696 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.668505] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] client_socket_timeout = 900 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.668646] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] config_dir = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.668761] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.668904] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] config_source = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.669059] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] control_exchange = neutron {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.669208] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] core_plugin = ml2 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.669355] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] debug = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.669500] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] default_availability_zones = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.669710] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.669859] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] dhcp_agent_notification = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.670010] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] dhcp_agents_per_network = 1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.670157] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] dhcp_lease_duration = 86400 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.670304] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] dhcp_load_type = networks {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.670447] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] dns_domain = openstacklocal {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.670590] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.670733] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] enable_default_route_bfd = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.670909] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] enable_default_route_ecmp = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.671042] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] enable_dvr = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.671185] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] enable_new_agents = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.671326] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.671465] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] enable_signals = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.671603] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] enable_traditional_dhcp = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.671739] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] external_dns_driver = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.671878] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] filter_validation = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.672039] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] global_physnet_mtu = 8950 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.672183] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] graceful_shutdown_timeout = 60 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.672364] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] host = cpu-1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.672512] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] host_dvr_for_dhcp = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.672717] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] http_retries = 3 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.672796] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] instance_format = [instance: %(uuid)s] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.672966] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.673123] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ipam_driver = internal {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.673253] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ipv6_pd_enabled = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.673394] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] l3_ha = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.673538] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.673681] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] l3_ha_network_physical_name = {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.673840] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] l3_ha_network_type = {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.673971] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_color = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.674127] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_config_append = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.674273] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.674428] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_dir = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.674542] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_file = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.674652] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_options = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.674793] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_rotate_interval = 1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.674942] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_rotate_interval_type = days {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.675100] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] log_rotation_type = none {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.675215] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.675323] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.675488] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.675606] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.675717] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.675860] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] max_dns_nameservers = 5 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.676013] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] max_header_line = 16384 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.676201] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] max_l3_agents_per_router = 3 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.676293] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] max_logfile_count = 30 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.676457] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] max_logfile_size_mb = 200 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.676568] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] max_subnet_host_routes = 20 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.676714] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] my_ip = 10.180.1.21 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.676860] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] my_ipv6 = ::1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.677011] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] network_auto_schedule = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.677150] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] network_link_prefix = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.677298] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.677448] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] notify_nova_on_port_data_changes = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.677592] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] notify_nova_on_port_status_changes = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.677833] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] pagination_max_limit = -1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.677898] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] publish_errors = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.678012] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] rate_limit_burst = 0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.678165] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] rate_limit_except_level = CRITICAL {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.678303] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] rate_limit_interval = 0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.678440] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] retry_until_window = 30 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.678580] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] router_distributed = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.678719] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] rpc_resources_processing_step = 20 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.678856] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] rpc_response_max_timeout = 600 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.678998] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] rpc_response_timeout = 60 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.679196] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] send_events_interval = 2 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.679302] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] service_plugins = ['router'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.679450] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] setproctitle = on {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.679588] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] shell_completion = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.679732] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] state_path = /opt/stack/data/neutron {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.679877] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] syslog_log_facility = LOG_USER {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.680038] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] tcp_keepidle = 600 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.680188] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] transport_url = **** {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.680333] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] use_journal = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.680470] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] use_json = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.680610] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] use_ssl = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.680747] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] use_stderr = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.680897] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] use_syslog = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.681048] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] vlan_qinq = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.681189] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] vlan_transparent = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.681327] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] watch_log_file = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.681465] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] wsgi_default_pool_size = 100 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.681602] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] wsgi_keep_alive = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.681748] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.681889] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] wsgi_server_debug = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 507.682057] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_concurrency.disable_process_locking = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.682212] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.682365] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.682512] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.682660] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.682805] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.682967] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.683119] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.connection_string = messaging:// {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.683275] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.enabled = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.683421] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.es_doc_type = notification {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.683567] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.es_scroll_size = 10000 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.683709] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.es_scroll_time = 2m {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.683851] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.filter_error_trace = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.684015] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.hmac_keys = **** {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.684155] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.sentinel_service_name = mymaster {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.684306] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.socket_timeout = 0.1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.684447] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.trace_requests = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.684588] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler.trace_sqlalchemy = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.684745] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler_jaeger.process_tags = {} {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.684881] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler_jaeger.service_name_prefix = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.685034] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] profiler_otlp.service_name_prefix = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.685197] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.enforce_new_defaults = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.685460] env[63014]: WARNING oslo_config.cfg [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 507.685617] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.enforce_scope = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.685768] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.policy_default_rule = default {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.685930] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.686091] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.686246] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.686390] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.686528] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.686668] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.686842] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.686962] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_policy.remote_timeout = 60.0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.687132] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.687330] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] agent.extensions = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.687429] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.687580] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] service_providers.service_provider = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.687729] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.default_quota = -1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.687919] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.688034] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_floatingip = 50 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.688168] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_network = 100 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.688312] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_port = 500 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.688453] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.688595] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_router = 10 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.688737] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_security_group = 10 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.688876] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.689028] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.quota_subnet = 100 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.689172] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] QUOTAS.track_quota_usage = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.689327] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.689470] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep.group = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.689604] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep.helper_command = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.689749] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.689893] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep.thread_pool_size = 8 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.690040] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep.user = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.690192] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.690329] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_dhcp_release.group = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.690463] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_dhcp_release.helper_command = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.690609] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.690756] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.690888] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_dhcp_release.user = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.691049] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.691190] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_ovs_vsctl.group = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.691329] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_ovs_vsctl.helper_command = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.691471] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.691612] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.691753] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_ovs_vsctl.user = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.691895] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_namespace.capabilities = [21] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.692043] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_namespace.group = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.692186] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_namespace.helper_command = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.692325] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.692470] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_namespace.thread_pool_size = 8 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.692605] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_namespace.user = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.692753] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_conntrack.capabilities = [12] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.692894] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_conntrack.group = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.693074] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_conntrack.helper_command = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.693186] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.693326] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.693457] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_conntrack.user = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.693609] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_link.capabilities = [12, 21] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.693743] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_link.group = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.693879] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_link.helper_command = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.694029] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.694171] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_link.thread_pool_size = 8 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.694308] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] privsep_link.user = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.694464] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.694617] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.694764] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.continue_on_failed_promotions = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.694901] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.dscp = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.695056] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.dscp_inherit = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.695205] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.force_mp_to_policy = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.695349] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.locking_coordinator_url = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.695487] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.log_agent_heartbeats = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.695625] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.logging_expire = 1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.695771] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.695913] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.696071] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.polling_interval = 240 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.696220] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.696366] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.696512] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.report_interval = 30.0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.696660] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.696803] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.696949] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.697106] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.sync_skew = 60 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.697249] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.synchronization_queue_size = 20 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.697395] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT.use_helper_for_ns_read = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.697543] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] SECURITYGROUP.enable_ipset = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.697690] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] SECURITYGROUP.enable_security_group = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.697836] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.698033] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.698138] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] experimental.ipv6_pd_enabled = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.698297] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.extension_drivers = ['port_security'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.698439] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.external_network_type = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.698593] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.698745] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.overlay_ip_version = 4 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.698899] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.path_mtu = 8950 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.699050] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.physical_network_mtus = {} {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.699206] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.tenant_network_types = ['vlan'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.699349] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.699499] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ml2.type_drivers = ['vlan'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.699647] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT_CLI.neutron_port_id = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.699785] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.699928] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.700094] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.700250] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.700400] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.700550] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.700697] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.700846] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.701056] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.701209] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_login_password = **** {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.701363] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_login_port = 443 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.701511] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_login_user = admin {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.701654] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.701799] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.701945] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.702097] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.702249] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.702399] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.702543] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.702689] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.702853] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.702978] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.703152] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.703300] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.703451] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.703645] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.703800] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] vsphere.vsphere_login_password = VMware1! {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.703949] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.704114] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.704283] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.auth_section = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.704417] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.auth_type = password {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.704566] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.704727] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.certfile = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.704848] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.collect_timing = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.704999] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.endpoint_type = public {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.705170] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.insecure = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.705298] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.keyfile = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.705449] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.region_name = RegionOne {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.705597] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.split_loggers = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.705741] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] nova.timeout = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.705885] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.auth_section = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.706049] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.auth_type = password {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.706200] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.706336] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.certfile = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.706480] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.collect_timing = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.706624] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.endpoint_type = public {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.706764] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.insecure = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.706901] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.keyfile = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.707045] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.region_name = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.707189] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.split_loggers = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.707323] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] placement.timeout = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.707473] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.auth_section = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.707614] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.auth_type = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.707751] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.cafile = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.707889] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.certfile = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.708088] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.collect_timing = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.708231] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.connect_retries = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.708308] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.connect_retry_delay = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.708448] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.enable_notifications = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.708588] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.endpoint_override = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.708728] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.insecure = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.708868] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.interface = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.709019] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.keyfile = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.709155] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.max_version = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.709294] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.min_version = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.709428] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.region_name = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.709567] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.retriable_status_codes = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.709703] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.service_name = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.709838] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.service_type = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.709986] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.split_loggers = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.710132] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.status_code_retries = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.710272] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.status_code_retry_delay = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.710410] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.timeout = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.710546] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.valid_interfaces = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.710688] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ironic.version = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.710839] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] cli_script.dry_run = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.710999] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.711156] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.711294] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.711440] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.711583] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.711737] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.711864] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.712020] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.712168] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.712301] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.712438] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.712586] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.712729] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.712881] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.713035] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.713229] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.713317] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.713460] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.713634] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.713736] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.713868] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.714019] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.714166] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.714313] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.714450] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.714607] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.714729] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.714871] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.715020] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.715159] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.715302] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.ssl = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.715450] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.715593] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.715733] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.715875] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.716024] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.ssl_version = {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.716168] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.716315] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_notifications.driver = [] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.716458] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_notifications.retry = -1 {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.716614] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.716754] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] oslo_messaging_notifications.transport_url = **** {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 507.716865] env[63014]: DEBUG oslo_service.backend.eventlet.service [None req-f69a88bb-268b-4410-80cc-3b49fffc2354 None None] ******************************************************************************** {{(pid=63014) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 507.717826] env[63014]: DEBUG neutron.agent.securitygroups_rpc [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Init firewall settings (driver=nsxv3) {{(pid=63014) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 507.719083] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=63014) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 507.719321] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] RPC agent_id: nsxm-l-01a.corp.local [ 507.721505] env[63014]: DEBUG dogpile.cache.region [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 507.721631] env[63014]: DEBUG dogpile.lock [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 507.721728] env[63014]: DEBUG dogpile.lock [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 507.721822] env[63014]: DEBUG dogpile.lock [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 507.721911] env[63014]: DEBUG dogpile.cache.region [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 507.722007] env[63014]: DEBUG dogpile.lock [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 507.722145] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 507.739107] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Session token - acquiring [ 507.740572] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 507.740780] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 507.740847] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 507.741575] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 507.750467] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 508.054966] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 508.079590] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 508.079751] env[63014]: DEBUG dogpile.cache.region [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Cache value generated in 0.358 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 508.079864] env[63014]: DEBUG dogpile.lock [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 508.079990] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Activating Policy API Provider. [ 508.080202] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Looking for the default Infrastructure Rules. [ 508.158282] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Looking for the Default Layer3 Logged Drop Section. [ 508.171213] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 508.171631] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 508.171807] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 508.171915] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 508.172220] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 508.172558] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 508.687308] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 509.189258] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 509.696502] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Inventory metadata is going to be refreshed. [ 509.696926] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 510.459271] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.459510] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.459568] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.459898] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.471952] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 510.581164] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.582158] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 510.601987] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.602204] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.602329] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.602577] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.602707] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.602896] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 510.603052] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 510.603133] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 510.622320] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.622480] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.622604] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.622888] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.623078] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.623225] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 510.641791] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.641975] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.642054] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.642300] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.642433] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.642572] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 510.663313] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.663458] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.663562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.663814] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.663954] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.664121] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 510.664227] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 510.664330] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 510.681768] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.681919] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.682034] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.682264] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.682377] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.682511] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 510.682616] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 510.682720] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 510.703783] env[63014]: DEBUG networking_nsxv3.common.locking [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.704104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.704104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.704309] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.704442] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.704582] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 510.704689] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 510.704792] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Inventory metadata have been refreshed. [ 510.704890] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Dryrun:True. Metadata refresh completed. [ 510.705017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Releasing lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.706656] env[63014]: INFO neutron.agent.agent_extensions_manager [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Loaded agent extensions: [] [ 510.707372] env[63014]: DEBUG neutron_lib.callbacks.manager [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=63014) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 510.762663] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent RPC Daemon Started! [ 510.762803] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent loop - iteration:0 started [ 510.762950] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent out of sync with plugin! [ 515.707570] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 515.707969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 520.710389] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 520.710656] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 524.365081] env[63014]: INFO networking_nsxv3.common.synchronization [None req-75082656-9fb7-407d-bc6d-ed14f5a89126 demo admin] Enqueued Resource ID: 981e1f67-c0e6-424b-9cea-f4e6c3e7fd35 with Priority: HIGHEST for action security_group_rules [ 524.365605] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 981e1f67-c0e6-424b-9cea-f4e6c3e7fd35 with Priority: HIGHEST for action security_group_rules [ 524.365894] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-981e1f67-c0e6-424b-9cea-f4e6c3e7fd35 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.366032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-981e1f67-c0e6-424b-9cea-f4e6c3e7fd35" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.366105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-981e1f67-c0e6-424b-9cea-f4e6c3e7fd35" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.366444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-981e1f67-c0e6-424b-9cea-f4e6c3e7fd35" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.366530] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('981e1f67-c0e6-424b-9cea-f4e6c3e7fd35',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.890595] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.890813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.890881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.891102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.891198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.891297] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 981e1f67-c0e6-424b-9cea-f4e6c3e7fd35 already deleted. [ 524.891380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-981e1f67-c0e6-424b-9cea-f4e6c3e7fd35" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 529.366442] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 529.367039] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 534.367812] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 534.368192] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 539.369066] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 539.369400] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 544.370536] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 544.370972] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 549.372122] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 549.372385] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.384658] env[63014]: INFO networking_nsxv3.common.synchronization [None req-2e6b4552-cb01-4d21-a33d-582e4082ee75 None None] Enqueued Resource ID: 9f017c68-0d06-4925-bef1-64e0cdb9d744 with Priority: HIGHEST for action port [ 550.384934] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f017c68-0d06-4925-bef1-64e0cdb9d744 with Priority: HIGHEST for action port [ 550.385565] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f017c68-0d06-4925-bef1-64e0cdb9d744 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.385756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f017c68-0d06-4925-bef1-64e0cdb9d744" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.385756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f017c68-0d06-4925-bef1-64e0cdb9d744" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.386016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f017c68-0d06-4925-bef1-64e0cdb9d744" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.386929] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f017c68-0d06-4925-bef1-64e0cdb9d744',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.448728] env[63014]: INFO networking_nsxv3.common.synchronization [None req-07a676e7-a97e-476a-9d2a-fe51e5d295e3 None None] Enqueued Resource ID: 901c765f-93f4-4faa-9dbd-3b107d859a1c with Priority: HIGHEST for action port [ 550.448990] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 901c765f-93f4-4faa-9dbd-3b107d859a1c with Priority: HIGHEST for action port [ 550.450931] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-901c765f-93f4-4faa-9dbd-3b107d859a1c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.450931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-901c765f-93f4-4faa-9dbd-3b107d859a1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.451311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-901c765f-93f4-4faa-9dbd-3b107d859a1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.451941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-901c765f-93f4-4faa-9dbd-3b107d859a1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.451941] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('901c765f-93f4-4faa-9dbd-3b107d859a1c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 550.890038] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f017c68-0d06-4925-bef1-64e0cdb9d744 [ 550.890371] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.890476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.890516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.890919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.890919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.890919] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f017c68-0d06-4925-bef1-64e0cdb9d744 already deleted. [ 550.891072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f017c68-0d06-4925-bef1-64e0cdb9d744" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.955621] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 901c765f-93f4-4faa-9dbd-3b107d859a1c [ 550.955865] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.956046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.956124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.956329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.956395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.956686] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:901c765f-93f4-4faa-9dbd-3b107d859a1c already deleted. [ 550.956686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-901c765f-93f4-4faa-9dbd-3b107d859a1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.629882] env[63014]: INFO networking_nsxv3.common.synchronization [None req-fe2e943d-2756-4c33-9bf4-30720908f2c5 None None] Enqueued Resource ID: 6ac5d876-f321-4eba-88c7-721c1e8d75b3 with Priority: HIGHEST for action port [ 551.629882] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ac5d876-f321-4eba-88c7-721c1e8d75b3 with Priority: HIGHEST for action port [ 551.630296] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ac5d876-f321-4eba-88c7-721c1e8d75b3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.630353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ac5d876-f321-4eba-88c7-721c1e8d75b3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.630420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ac5d876-f321-4eba-88c7-721c1e8d75b3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.630648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ac5d876-f321-4eba-88c7-721c1e8d75b3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.630726] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ac5d876-f321-4eba-88c7-721c1e8d75b3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.135314] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ac5d876-f321-4eba-88c7-721c1e8d75b3 [ 552.136844] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.136844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.136844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.136844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.136844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.136844] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ac5d876-f321-4eba-88c7-721c1e8d75b3 already deleted. [ 552.136844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ac5d876-f321-4eba-88c7-721c1e8d75b3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.568535] env[63014]: INFO networking_nsxv3.common.synchronization [None req-1d676b14-bdd6-4863-a503-2d06f3ed2b9f None None] Enqueued Resource ID: 1641a87d-f96c-40fd-8649-894d63e711c8 with Priority: HIGHEST for action port [ 552.568799] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1641a87d-f96c-40fd-8649-894d63e711c8 with Priority: HIGHEST for action port [ 552.569799] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-1641a87d-f96c-40fd-8649-894d63e711c8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.569799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1641a87d-f96c-40fd-8649-894d63e711c8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.569799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1641a87d-f96c-40fd-8649-894d63e711c8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.569799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1641a87d-f96c-40fd-8649-894d63e711c8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.569994] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1641a87d-f96c-40fd-8649-894d63e711c8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.690985] env[63014]: INFO networking_nsxv3.common.synchronization [None req-506d6749-7971-4b9e-ba12-77b8705e24ed None None] Enqueued Resource ID: 4f64a1fe-7d55-415f-829e-84a7d432323b with Priority: HIGHEST for action port [ 552.691287] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f64a1fe-7d55-415f-829e-84a7d432323b with Priority: HIGHEST for action port [ 552.692219] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f64a1fe-7d55-415f-829e-84a7d432323b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.692219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f64a1fe-7d55-415f-829e-84a7d432323b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.692320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f64a1fe-7d55-415f-829e-84a7d432323b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.694103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f64a1fe-7d55-415f-829e-84a7d432323b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.694252] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f64a1fe-7d55-415f-829e-84a7d432323b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.073056] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1641a87d-f96c-40fd-8649-894d63e711c8 [ 553.073372] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.073522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.073656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.073902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.074044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.074180] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1641a87d-f96c-40fd-8649-894d63e711c8 already deleted. [ 553.074297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1641a87d-f96c-40fd-8649-894d63e711c8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.196426] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f64a1fe-7d55-415f-829e-84a7d432323b [ 553.196680] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.196805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.196885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.197986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.198123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.198290] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f64a1fe-7d55-415f-829e-84a7d432323b already deleted. [ 553.198351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f64a1fe-7d55-415f-829e-84a7d432323b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.545020] env[63014]: INFO networking_nsxv3.common.synchronization [None req-36ce1350-5f79-4fe7-aa55-6dfc3b4900be None None] Enqueued Resource ID: 583a9e3c-5772-42bd-8027-1364d8218b05 with Priority: HIGHEST for action port [ 553.545020] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583a9e3c-5772-42bd-8027-1364d8218b05 with Priority: HIGHEST for action port [ 553.545020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-583a9e3c-5772-42bd-8027-1364d8218b05 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.545020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-583a9e3c-5772-42bd-8027-1364d8218b05" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.545020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-583a9e3c-5772-42bd-8027-1364d8218b05" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.545020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-583a9e3c-5772-42bd-8027-1364d8218b05" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.545020] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583a9e3c-5772-42bd-8027-1364d8218b05',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.648358] env[63014]: INFO networking_nsxv3.common.synchronization [None req-12c0cd71-ca3b-4227-afe8-336b7ab7def3 None None] Enqueued Resource ID: 4f19973b-5558-4ab8-a153-78887dc7b5be with Priority: HIGHEST for action port [ 553.648632] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f19973b-5558-4ab8-a153-78887dc7b5be with Priority: HIGHEST for action port [ 553.649174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f19973b-5558-4ab8-a153-78887dc7b5be taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.649304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f19973b-5558-4ab8-a153-78887dc7b5be" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.649368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f19973b-5558-4ab8-a153-78887dc7b5be" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.649611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f19973b-5558-4ab8-a153-78887dc7b5be" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.649718] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f19973b-5558-4ab8-a153-78887dc7b5be',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.047534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 583a9e3c-5772-42bd-8027-1364d8218b05 [ 554.047776] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.048597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.048597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.048597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.048597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.048597] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:583a9e3c-5772-42bd-8027-1364d8218b05 already deleted. [ 554.048597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-583a9e3c-5772-42bd-8027-1364d8218b05" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.153808] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f19973b-5558-4ab8-a153-78887dc7b5be [ 554.153967] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.154153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.154757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.154990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.155126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.155232] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f19973b-5558-4ab8-a153-78887dc7b5be already deleted. [ 554.155319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f19973b-5558-4ab8-a153-78887dc7b5be" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.646976] env[63014]: INFO networking_nsxv3.common.synchronization [None req-8e80fda7-f8ce-4e06-be99-bbbcdea22096 None None] Enqueued Resource ID: e38a1a77-802c-440f-9a3d-41a35e9be525 with Priority: HIGHEST for action port [ 555.647381] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38a1a77-802c-440f-9a3d-41a35e9be525 with Priority: HIGHEST for action port [ 555.647812] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e38a1a77-802c-440f-9a3d-41a35e9be525 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.647955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e38a1a77-802c-440f-9a3d-41a35e9be525" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.648096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e38a1a77-802c-440f-9a3d-41a35e9be525" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.648260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e38a1a77-802c-440f-9a3d-41a35e9be525" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.648341] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e38a1a77-802c-440f-9a3d-41a35e9be525',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.097789] env[63014]: INFO networking_nsxv3.common.synchronization [None req-125a8b03-81b1-43cc-890f-887d9c68b4db None None] Enqueued Resource ID: b46d4886-5ee4-4ee8-8a93-ffc8de7bc758 with Priority: HIGHEST for action port [ 556.098356] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b46d4886-5ee4-4ee8-8a93-ffc8de7bc758 with Priority: HIGHEST for action port [ 556.100478] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-b46d4886-5ee4-4ee8-8a93-ffc8de7bc758 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.100478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b46d4886-5ee4-4ee8-8a93-ffc8de7bc758" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.100628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b46d4886-5ee4-4ee8-8a93-ffc8de7bc758" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.100928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b46d4886-5ee4-4ee8-8a93-ffc8de7bc758" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.100928] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b46d4886-5ee4-4ee8-8a93-ffc8de7bc758',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.150266] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e38a1a77-802c-440f-9a3d-41a35e9be525 [ 556.150530] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.150678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.150749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.150978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.151144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.151293] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e38a1a77-802c-440f-9a3d-41a35e9be525 already deleted. [ 556.151423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e38a1a77-802c-440f-9a3d-41a35e9be525" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.596272] env[63014]: INFO networking_nsxv3.common.synchronization [None req-39dda8ca-c0ef-489d-aefd-249440e38446 None None] Enqueued Resource ID: e10933bf-adf7-4a92-a2ce-00ebb4387587 with Priority: HIGHEST for action port [ 556.596272] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e10933bf-adf7-4a92-a2ce-00ebb4387587 with Priority: HIGHEST for action port [ 556.596570] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e10933bf-adf7-4a92-a2ce-00ebb4387587 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.597019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e10933bf-adf7-4a92-a2ce-00ebb4387587" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.597126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e10933bf-adf7-4a92-a2ce-00ebb4387587" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.597371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e10933bf-adf7-4a92-a2ce-00ebb4387587" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.597487] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e10933bf-adf7-4a92-a2ce-00ebb4387587',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.604216] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b46d4886-5ee4-4ee8-8a93-ffc8de7bc758 [ 556.604438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.604575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.604625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.604851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.605074] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.605074] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b46d4886-5ee4-4ee8-8a93-ffc8de7bc758 already deleted. [ 556.605150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b46d4886-5ee4-4ee8-8a93-ffc8de7bc758" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.100584] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e10933bf-adf7-4a92-a2ce-00ebb4387587 [ 557.100584] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.100894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.100894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.100968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.101156] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.101239] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e10933bf-adf7-4a92-a2ce-00ebb4387587 already deleted. [ 557.101327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e10933bf-adf7-4a92-a2ce-00ebb4387587" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.531855] env[63014]: INFO networking_nsxv3.common.synchronization [None req-61c48eb5-a554-4879-b1bd-e2aea286c271 None None] Enqueued Resource ID: f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7 with Priority: HIGHEST for action port [ 557.532046] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7 with Priority: HIGHEST for action port [ 557.532689] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.532765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.532765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.533115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.535037] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.908786] env[63014]: INFO networking_nsxv3.common.synchronization [None req-6aa37823-13d2-4d2d-a9e8-b5113ffb59aa None None] Enqueued Resource ID: d7a34fed-97c6-4d9f-9377-287069aefab1 with Priority: HIGHEST for action port [ 557.909515] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7a34fed-97c6-4d9f-9377-287069aefab1 with Priority: HIGHEST for action port [ 557.909617] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7a34fed-97c6-4d9f-9377-287069aefab1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.909736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7a34fed-97c6-4d9f-9377-287069aefab1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.909800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7a34fed-97c6-4d9f-9377-287069aefab1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.913789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7a34fed-97c6-4d9f-9377-287069aefab1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.914208] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7a34fed-97c6-4d9f-9377-287069aefab1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.039444] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7 [ 558.039721] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.039919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.039919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.040139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.040222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.040689] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7 already deleted. [ 558.040689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f192ff4b-e4a2-4f08-a136-bc3cd34e8ae7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.416439] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7a34fed-97c6-4d9f-9377-287069aefab1 [ 558.417017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.417173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.417336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.417459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.417558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.417663] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7a34fed-97c6-4d9f-9377-287069aefab1 already deleted. [ 558.417752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7a34fed-97c6-4d9f-9377-287069aefab1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.440557] env[63014]: INFO networking_nsxv3.common.synchronization [None req-715a9336-7a4b-426e-a912-4f490ea985e0 None None] Enqueued Resource ID: 2ae5abe2-5d23-4bef-be3a-a6320f3ced43 with Priority: HIGHEST for action port [ 558.440885] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ae5abe2-5d23-4bef-be3a-a6320f3ced43 with Priority: HIGHEST for action port [ 558.441455] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ae5abe2-5d23-4bef-be3a-a6320f3ced43 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.441580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ae5abe2-5d23-4bef-be3a-a6320f3ced43" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.441650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ae5abe2-5d23-4bef-be3a-a6320f3ced43" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.441902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ae5abe2-5d23-4bef-be3a-a6320f3ced43" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.441982] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ae5abe2-5d23-4bef-be3a-a6320f3ced43',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.720133] env[63014]: INFO networking_nsxv3.common.synchronization [None req-5c3b9959-8a86-43e3-817e-daf2c4d37bc0 None None] Enqueued Resource ID: 88570bad-0e93-4f73-836a-886219bac739 with Priority: HIGHEST for action port [ 558.721027] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88570bad-0e93-4f73-836a-886219bac739 with Priority: HIGHEST for action port [ 558.721027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-88570bad-0e93-4f73-836a-886219bac739 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.721027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88570bad-0e93-4f73-836a-886219bac739" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.721027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88570bad-0e93-4f73-836a-886219bac739" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.722574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88570bad-0e93-4f73-836a-886219bac739" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.722574] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88570bad-0e93-4f73-836a-886219bac739',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.946740] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ae5abe2-5d23-4bef-be3a-a6320f3ced43 [ 558.947070] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.947143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.947212] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.947427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.947524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.947623] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ae5abe2-5d23-4bef-be3a-a6320f3ced43 already deleted. [ 558.947705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ae5abe2-5d23-4bef-be3a-a6320f3ced43" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.225095] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88570bad-0e93-4f73-836a-886219bac739 [ 559.225374] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.225580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.225580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.226829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.226829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.226829] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88570bad-0e93-4f73-836a-886219bac739 already deleted. [ 559.226829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88570bad-0e93-4f73-836a-886219bac739" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.994615] env[63014]: INFO networking_nsxv3.common.synchronization [None req-00f90ca3-162c-4842-abdd-bf2d94f87d3d tempest-ServersTestBootFromVolume-1738521807 tempest-ServersTestBootFromVolume-1738521807-project-member] Enqueued Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_rules [ 559.995693] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_rules [ 559.995693] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.995693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.995693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.995908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.995945] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.067943] env[63014]: INFO networking_nsxv3.common.synchronization [None req-20c100d1-3e26-417d-ba56-401b142ff8d8 None None] Enqueued Resource ID: 7522e93a-51f8-48af-a49b-ad2d81df38ed with Priority: HIGHEST for action port [ 560.068507] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7522e93a-51f8-48af-a49b-ad2d81df38ed with Priority: HIGHEST for action port [ 560.068647] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-7522e93a-51f8-48af-a49b-ad2d81df38ed taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.068837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7522e93a-51f8-48af-a49b-ad2d81df38ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.068990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7522e93a-51f8-48af-a49b-ad2d81df38ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.069224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7522e93a-51f8-48af-a49b-ad2d81df38ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.069321] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7522e93a-51f8-48af-a49b-ad2d81df38ed',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.213847] env[63014]: INFO networking_nsxv3.common.synchronization [None req-109ff2f6-52c2-4ec4-9c29-e592735c2d62 tempest-ServersTestBootFromVolume-1738521807 tempest-ServersTestBootFromVolume-1738521807-project-member] Enqueued Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_rules [ 560.214562] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_rules [ 560.214956] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.215328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.525042] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.525042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.525489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.525489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.525489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.525660] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba already deleted. [ 560.525660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.526104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.526104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.526104] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.572897] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7522e93a-51f8-48af-a49b-ad2d81df38ed [ 560.573215] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.573365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.573506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.574365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.574498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.574602] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7522e93a-51f8-48af-a49b-ad2d81df38ed already deleted. [ 560.574688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7522e93a-51f8-48af-a49b-ad2d81df38ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.048295] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.049225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.049225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.049225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.049225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.049225] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba already deleted. [ 561.049225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.640867] env[63014]: INFO networking_nsxv3.common.synchronization [None req-a2f06586-360c-4b6f-9525-7e6587051fc8 None None] Enqueued Resource ID: 7f186c88-b22b-42c2-a355-57f9335241da with Priority: HIGHEST for action port [ 561.640867] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f186c88-b22b-42c2-a355-57f9335241da with Priority: HIGHEST for action port [ 561.641156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f186c88-b22b-42c2-a355-57f9335241da taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.641286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f186c88-b22b-42c2-a355-57f9335241da" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.641350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f186c88-b22b-42c2-a355-57f9335241da" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.641605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f186c88-b22b-42c2-a355-57f9335241da" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.641675] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f186c88-b22b-42c2-a355-57f9335241da',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 562.144910] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f186c88-b22b-42c2-a355-57f9335241da [ 562.145486] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.145486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.145486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.145612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.145675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.145772] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f186c88-b22b-42c2-a355-57f9335241da already deleted. [ 562.145854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f186c88-b22b-42c2-a355-57f9335241da" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.921402] env[63014]: INFO networking_nsxv3.common.synchronization [None req-fdd9b92c-384a-4b75-9967-bb86a3793a35 None None] Enqueued Resource ID: 62fb9a15-6054-41eb-bbf0-3f20cf78f2ac with Priority: HIGHEST for action port [ 562.921402] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62fb9a15-6054-41eb-bbf0-3f20cf78f2ac with Priority: HIGHEST for action port [ 562.921402] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-62fb9a15-6054-41eb-bbf0-3f20cf78f2ac taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.921402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62fb9a15-6054-41eb-bbf0-3f20cf78f2ac" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.921402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62fb9a15-6054-41eb-bbf0-3f20cf78f2ac" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.923531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62fb9a15-6054-41eb-bbf0-3f20cf78f2ac" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.923531] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62fb9a15-6054-41eb-bbf0-3f20cf78f2ac',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.427366] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62fb9a15-6054-41eb-bbf0-3f20cf78f2ac [ 563.427366] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.427366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.428660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.428660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.428660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.428660] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62fb9a15-6054-41eb-bbf0-3f20cf78f2ac already deleted. [ 563.428660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62fb9a15-6054-41eb-bbf0-3f20cf78f2ac" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.808020] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ea88c35a-46db-46ec-a191-c5b7b74ba895 None None] Enqueued Resource ID: 7b5c97ad-7772-49b1-a26f-90f5aeb26822 with Priority: HIGHEST for action port [ 563.808020] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b5c97ad-7772-49b1-a26f-90f5aeb26822 with Priority: HIGHEST for action port [ 563.808020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b5c97ad-7772-49b1-a26f-90f5aeb26822 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.808020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b5c97ad-7772-49b1-a26f-90f5aeb26822" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.808020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b5c97ad-7772-49b1-a26f-90f5aeb26822" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.808020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b5c97ad-7772-49b1-a26f-90f5aeb26822" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.808020] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b5c97ad-7772-49b1-a26f-90f5aeb26822',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.115724] env[63014]: INFO networking_nsxv3.common.synchronization [None req-cfe3247e-b807-4c49-8847-5c5deb14e0c6 tempest-VolumesAdminNegativeTest-1905375078 tempest-VolumesAdminNegativeTest-1905375078-project-member] Enqueued Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_rules [ 564.116283] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_rules [ 564.116668] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.116758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.116794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.118017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.118017] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.311756] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b5c97ad-7772-49b1-a26f-90f5aeb26822 [ 564.311756] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.311756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.311756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.311756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.311756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.311756] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b5c97ad-7772-49b1-a26f-90f5aeb26822 already deleted. [ 564.311756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b5c97ad-7772-49b1-a26f-90f5aeb26822" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.373932] env[63014]: INFO networking_nsxv3.common.synchronization [None req-2da1df1a-dca7-4f61-aae1-44beadc968f7 tempest-VolumesAdminNegativeTest-1905375078 tempest-VolumesAdminNegativeTest-1905375078-project-member] Enqueued Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_rules [ 564.374493] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_rules [ 564.374912] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.374912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.642027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.642027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.642027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.642027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.642027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.642027] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 already deleted. [ 564.642027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.642027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.642613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.642613] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.978959] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d15558ef-0ec0-4cc7-8e1f-96e28ef77740 None None] Enqueued Resource ID: 4596ad75-6af1-4c47-a70b-83be6d7a7260 with Priority: HIGHEST for action port [ 564.979236] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4596ad75-6af1-4c47-a70b-83be6d7a7260 with Priority: HIGHEST for action port [ 564.979772] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-4596ad75-6af1-4c47-a70b-83be6d7a7260 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.979905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4596ad75-6af1-4c47-a70b-83be6d7a7260" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.980027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4596ad75-6af1-4c47-a70b-83be6d7a7260" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.982540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4596ad75-6af1-4c47-a70b-83be6d7a7260" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.982633] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4596ad75-6af1-4c47-a70b-83be6d7a7260',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.163324] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.163324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.163324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.163324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.163324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.163324] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 already deleted. [ 565.163324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.485443] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4596ad75-6af1-4c47-a70b-83be6d7a7260 [ 565.486687] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.486687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.486687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.486687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.486687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.486687] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4596ad75-6af1-4c47-a70b-83be6d7a7260 already deleted. [ 565.486687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4596ad75-6af1-4c47-a70b-83be6d7a7260" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.762729] env[63014]: INFO networking_nsxv3.common.synchronization [None req-49bfe112-3822-4cb5-981d-f72b4717a0f0 None None] Enqueued Resource ID: ba14e1e6-40a3-4122-8e86-a35de5c40e26 with Priority: HIGHEST for action port [ 565.763972] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba14e1e6-40a3-4122-8e86-a35de5c40e26 with Priority: HIGHEST for action port [ 565.764542] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba14e1e6-40a3-4122-8e86-a35de5c40e26 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.764903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba14e1e6-40a3-4122-8e86-a35de5c40e26" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.766305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba14e1e6-40a3-4122-8e86-a35de5c40e26" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.766305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba14e1e6-40a3-4122-8e86-a35de5c40e26" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.766305] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba14e1e6-40a3-4122-8e86-a35de5c40e26',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.271124] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba14e1e6-40a3-4122-8e86-a35de5c40e26 [ 566.271124] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.271124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.271343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.271401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.271491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.271654] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba14e1e6-40a3-4122-8e86-a35de5c40e26 already deleted. [ 566.271743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba14e1e6-40a3-4122-8e86-a35de5c40e26" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.513061] env[63014]: INFO networking_nsxv3.common.synchronization [req-c01bc3bd-7ee8-4fd5-99ac-2bf24a8ce107 req-5a311af6-218e-41ff-85c7-d859de54ae07 tempest-FloatingIPsAssociationTestJSON-1182186772 tempest-FloatingIPsAssociationTestJSON-1182186772-project-member] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 566.513061] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 566.513061] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.513061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.513061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.513061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.513061] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.513061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.513061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.513061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.513061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.513061] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.568993] env[63014]: INFO networking_nsxv3.common.synchronization [None req-024733a0-aa90-4188-9122-e12b0e2fdcfa None None] Enqueued Resource ID: 0aab5a5a-a3aa-48d8-acdd-e08238917d71 with Priority: HIGHEST for action port [ 566.568993] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aab5a5a-a3aa-48d8-acdd-e08238917d71 with Priority: HIGHEST for action port [ 566.569511] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aab5a5a-a3aa-48d8-acdd-e08238917d71 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.569780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aab5a5a-a3aa-48d8-acdd-e08238917d71" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.569906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aab5a5a-a3aa-48d8-acdd-e08238917d71" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.570245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aab5a5a-a3aa-48d8-acdd-e08238917d71" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.570383] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aab5a5a-a3aa-48d8-acdd-e08238917d71',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.014661] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.014948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.014948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.015104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.015209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.015439] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.015545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.015617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.016132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.016132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.016132] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 already deleted. [ 567.016132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.075819] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0aab5a5a-a3aa-48d8-acdd-e08238917d71 [ 567.075819] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.075819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.075819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.075819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.075819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.075819] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0aab5a5a-a3aa-48d8-acdd-e08238917d71 already deleted. [ 567.075819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aab5a5a-a3aa-48d8-acdd-e08238917d71" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.331356] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.331607] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-931" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.331767] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-931" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.332137] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-931" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.332434] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.332801] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.332801] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.333057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.333258] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.333578] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 567.334094] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 567.334276] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 567.334425] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 567.334627] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 567.334725] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 567.334901] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 567.345964] env[63014]: INFO networking_nsxv3.common.synchronization [None req-0816690d-e8fb-43e9-b779-567b9f0eb8d2 None None] Enqueued Resource ID: 3619f7c8-a01a-41da-b49d-a59c8c495615 with Priority: HIGHEST for action port [ 567.346977] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3619f7c8-a01a-41da-b49d-a59c8c495615 with Priority: HIGHEST for action port [ 567.347291] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-3619f7c8-a01a-41da-b49d-a59c8c495615 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.347407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3619f7c8-a01a-41da-b49d-a59c8c495615" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.348140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3619f7c8-a01a-41da-b49d-a59c8c495615" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.348140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3619f7c8-a01a-41da-b49d-a59c8c495615" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.348140] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3619f7c8-a01a-41da-b49d-a59c8c495615',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.357869] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 567.358101] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 567.358229] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 567.358354] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-931" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.358675] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-782e3325-0358-46d7-b64c-eb2fa6451d18 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.358990] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-782e3325-0358-46d7-b64c-eb2fa6451d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.358990] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-782e3325-0358-46d7-b64c-eb2fa6451d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.359317] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-782e3325-0358-46d7-b64c-eb2fa6451d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.359751] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('782e3325-0358-46d7-b64c-eb2fa6451d18',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.849356] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3619f7c8-a01a-41da-b49d-a59c8c495615 [ 567.849629] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.850072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.850193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.850872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.851607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.852110] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3619f7c8-a01a-41da-b49d-a59c8c495615 already deleted. [ 567.852246] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3619f7c8-a01a-41da-b49d-a59c8c495615" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.861445] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.861769] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.861957] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.862270] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.862461] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.862621] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 782e3325-0358-46d7-b64c-eb2fa6451d18 not found, creating... [ 567.862887] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.863462] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.863462] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.863567] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.863678] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.864077] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.864421] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.864490] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.864727] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.864890] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.865066] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 782e3325-0358-46d7-b64c-eb2fa6451d18 is going to be created. [ 567.900051] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.903024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.903024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.903024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.903024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.903024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-782e3325-0358-46d7-b64c-eb2fa6451d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.958390] env[63014]: INFO networking_nsxv3.common.synchronization [None req-143b451b-013c-4d96-8ab8-9e365b02bddc None None] Enqueued Resource ID: 6ba4f7f9-2988-42ba-9ef9-dae407902b2c with Priority: HIGHEST for action port [ 567.959030] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba4f7f9-2988-42ba-9ef9-dae407902b2c with Priority: HIGHEST for action port [ 567.960467] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ba4f7f9-2988-42ba-9ef9-dae407902b2c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.960467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ba4f7f9-2988-42ba-9ef9-dae407902b2c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.960467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ba4f7f9-2988-42ba-9ef9-dae407902b2c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.960467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ba4f7f9-2988-42ba-9ef9-dae407902b2c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.960467] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba4f7f9-2988-42ba-9ef9-dae407902b2c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.463529] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ba4f7f9-2988-42ba-9ef9-dae407902b2c [ 568.463529] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.463529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.463529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.463870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.463870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.463870] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ba4f7f9-2988-42ba-9ef9-dae407902b2c already deleted. [ 568.464043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ba4f7f9-2988-42ba-9ef9-dae407902b2c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.628778] env[63014]: INFO networking_nsxv3.common.synchronization [None req-c75d535d-d661-41da-ab31-fdb7d383ff84 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_rules [ 568.629226] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_rules [ 568.629559] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.629770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.629852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.631879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.632045] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.836145] env[63014]: INFO networking_nsxv3.common.synchronization [None req-e38a3e1a-b46e-42a9-bba2-93371788f4ee tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_rules [ 568.837078] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_rules [ 568.839168] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.839329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.886040] env[63014]: INFO networking_nsxv3.common.synchronization [None req-71368746-b698-4dcd-91d8-8288999f99b6 tempest-VolumesAssistedSnapshotsTest-148737378 tempest-VolumesAssistedSnapshotsTest-148737378-project-member] Enqueued Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_rules [ 568.886843] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_rules [ 568.887215] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.888124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.888124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.888124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.888124] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.984019] env[63014]: INFO networking_nsxv3.common.synchronization [None req-6aca4382-728f-4126-9dea-f45daa48399e tempest-VolumesAssistedSnapshotsTest-148737378 tempest-VolumesAssistedSnapshotsTest-148737378-project-member] Enqueued Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_rules [ 568.985314] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_rules [ 568.985314] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.985314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.153497] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.154809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.154809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.154809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.154809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.154809] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b44cf44-3516-4644-9659-498297843d9a already deleted. [ 569.154809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.154809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.154809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.154809] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.222297] env[63014]: INFO networking_nsxv3.common.synchronization [req-c01bc3bd-7ee8-4fd5-99ac-2bf24a8ce107 req-acade9d8-a24b-47d2-a0ca-8515d66dc982 service nova] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_rules [ 569.222511] env[63014]: INFO networking_nsxv3.common.synchronization [req-c01bc3bd-7ee8-4fd5-99ac-2bf24a8ce107 req-acade9d8-a24b-47d2-a0ca-8515d66dc982 service nova] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 569.222671] env[63014]: INFO networking_nsxv3.common.synchronization [req-c01bc3bd-7ee8-4fd5-99ac-2bf24a8ce107 req-acade9d8-a24b-47d2-a0ca-8515d66dc982 service nova] Enqueued Resource ID: 782e3325-0358-46d7-b64c-eb2fa6451d18 with Priority: HIGHEST for action port [ 569.223039] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_rules [ 569.223039] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 569.223334] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 782e3325-0358-46d7-b64c-eb2fa6451d18 with Priority: HIGHEST for action port [ 569.224075] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.224075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.224075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.225341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.226233] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.227720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.227720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.227720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.227720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.228836] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.228836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.228836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.228836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.228836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.228836] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.234025] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-782e3325-0358-46d7-b64c-eb2fa6451d18 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.234025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-782e3325-0358-46d7-b64c-eb2fa6451d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.234025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-782e3325-0358-46d7-b64c-eb2fa6451d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.234025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-782e3325-0358-46d7-b64c-eb2fa6451d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.234025] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('782e3325-0358-46d7-b64c-eb2fa6451d18',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.408094] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.408590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.408590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.408694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.408947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.408947] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 already deleted. [ 569.409056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.409471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.409693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.410541] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.675393] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.675674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.675674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.675760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.676166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.676166] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b44cf44-3516-4644-9659-498297843d9a already deleted. [ 569.676166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.710429] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.710555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.710606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.710816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.711054] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.733764] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.733764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.739019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.739439] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 782e3325-0358-46d7-b64c-eb2fa6451d18 with status ACTIVE [ 569.739599] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.739720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.739783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.739980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.740080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.740260] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.740360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.740421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.740571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.740649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.740820] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.740910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.740969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.743435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.743435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.743435] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 782e3325-0358-46d7-b64c-eb2fa6451d18 is going to be updated. [ 569.766774] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.766987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.766987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.767080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.767224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.767371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-782e3325-0358-46d7-b64c-eb2fa6451d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.779540] env[63014]: INFO networking_nsxv3.common.synchronization [None req-0a02200f-1750-4d01-8fe6-4d4e9d047660 None None] Enqueued Resource ID: 2f40c8a7-f270-4b59-83de-c5f7847b9e8c with Priority: HIGHEST for action port [ 569.779673] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f40c8a7-f270-4b59-83de-c5f7847b9e8c with Priority: HIGHEST for action port [ 569.779975] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f40c8a7-f270-4b59-83de-c5f7847b9e8c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.780358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f40c8a7-f270-4b59-83de-c5f7847b9e8c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.780358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f40c8a7-f270-4b59-83de-c5f7847b9e8c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.780453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f40c8a7-f270-4b59-83de-c5f7847b9e8c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.780486] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f40c8a7-f270-4b59-83de-c5f7847b9e8c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.934157] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.934308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.934374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.934584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.934666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.934776] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 already deleted. [ 569.934828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.213336] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.246066] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.283669] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f40c8a7-f270-4b59-83de-c5f7847b9e8c [ 570.283669] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.283847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.283847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.284140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.284236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.284331] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f40c8a7-f270-4b59-83de-c5f7847b9e8c already deleted. [ 570.284406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f40c8a7-f270-4b59-83de-c5f7847b9e8c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.435477] env[63014]: INFO networking_nsxv3.common.synchronization [None req-501f13d7-5b98-4203-993e-1430f12dda87 None None] Enqueued Resource ID: 62e1f6c8-26cc-4a01-ab30-a94d27005365 with Priority: HIGHEST for action port [ 570.436437] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62e1f6c8-26cc-4a01-ab30-a94d27005365 with Priority: HIGHEST for action port [ 570.437307] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-62e1f6c8-26cc-4a01-ab30-a94d27005365 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.437307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62e1f6c8-26cc-4a01-ab30-a94d27005365" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.437307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62e1f6c8-26cc-4a01-ab30-a94d27005365" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.439027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62e1f6c8-26cc-4a01-ab30-a94d27005365" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.439027] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e1f6c8-26cc-4a01-ab30-a94d27005365',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.657691] env[63014]: INFO networking_nsxv3.common.synchronization [req-a61736d7-9e3a-4a41-89d9-6a70c96d5d4b req-a90c01bb-f779-41ac-9a70-f7cc3bcc4f2e tempest-TenantUsagesTestJSON-670335680 tempest-TenantUsagesTestJSON-670335680-project-member] Enqueued Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGHEST for action security_group_members [ 570.657691] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGHEST for action security_group_members [ 570.660112] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e5887-ef6d-4e88-a132-91dc117462bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.660112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.660112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.660112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.660112] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.660112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.660112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.660112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.660112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.660112] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.718449] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.751471] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.751471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.751471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.751471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.751471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.751471] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 is going to be created. [ 570.831660] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.831902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.832187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.832256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.832370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.850302] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: UNINITIALIZED for 2s [ 570.942030] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62e1f6c8-26cc-4a01-ab30-a94d27005365 [ 570.942030] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.942030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.942030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.942030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.942030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.942030] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62e1f6c8-26cc-4a01-ab30-a94d27005365 already deleted. [ 570.942030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62e1f6c8-26cc-4a01-ab30-a94d27005365" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.164352] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.164352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.165281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.165281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.165281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.165281] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.165500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.165500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.165635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.165740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.165830] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e5887-ef6d-4e88-a132-91dc117462bb already deleted. [ 571.165915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.223802] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 571.223802] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 571.289123] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.289354] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.289510] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.289864] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.290641] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.290810] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.290930] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.295268] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.295439] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.295908] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 571.295908] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 571.296023] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 571.296103] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 571.296453] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 571.296453] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 571.296453] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 571.323282] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 571.323471] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 571.323613] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 571.323791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.324117] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-e038b344-b578-4e31-867d-0e2aa922d611 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.324297] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-e038b344-b578-4e31-867d-0e2aa922d611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.326269] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-e038b344-b578-4e31-867d-0e2aa922d611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.326269] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-e038b344-b578-4e31-867d-0e2aa922d611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.326269] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e038b344-b578-4e31-867d-0e2aa922d611',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.834164] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.834164] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.834164] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.834164] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.834164] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.834164] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port e038b344-b578-4e31-867d-0e2aa922d611 not found, creating... [ 571.834164] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.834164] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.834936] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.835390] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.835833] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.836322] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.839374] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.839374] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.839374] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.839374] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.839374] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: e038b344-b578-4e31-867d-0e2aa922d611 is going to be created. [ 571.859483] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.859727] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.859854] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.860182] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.860367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.860588] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-e038b344-b578-4e31-867d-0e2aa922d611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.031266] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.031470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.031567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.031789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.048354] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 572.050462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.051329] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 572.072179] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.072179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.072179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.072179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.072179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.072179] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 572.072179] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.072179] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 572.097937] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.097937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.097937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.097937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.097937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.097937] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 572.120733] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.120733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.120733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.120733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.120733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.120733] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 572.139958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.140204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.140311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.141039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.141039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.141267] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 572.141554] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.141554] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 572.169919] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.170103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.170166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.170387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.170508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.170616] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 572.170687] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.170830] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 572.193316] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.193500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.193576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.193842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.194036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.194258] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 572.194306] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 572.194372] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 572.194424] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 572.195522] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 572.195522] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 572.195522] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 572.195522] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , >, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.195522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.195795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.196070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.196195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.196431] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , >, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.196560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.196624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.196808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.196883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.197250] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 572.197344] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 572.197430] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 572.218468] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.218661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.218661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.220381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.220381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.220381] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 572.239288] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.239453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.239543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.239727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.239822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.273874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.298992] env[63014]: INFO networking_nsxv3.common.synchronization [req-a8306ce3-db9d-45f8-ba5f-c5f2685ac948 req-5e3839f9-6192-4ac0-899a-e155127512b0 tempest-DeleteServersAdminTestJSON-1653377477 tempest-DeleteServersAdminTestJSON-1653377477-project-member] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 572.301376] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 572.301376] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.301376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.301376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.302044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.302806] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.302806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.302932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.303204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.303204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.303320] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.577980] env[63014]: INFO networking_nsxv3.common.synchronization [None req-877436b7-a899-4644-9d27-c2138189eed3 None None] Enqueued Resource ID: 3006dbf1-a25c-4a26-be12-12c344f7d94f with Priority: HIGHEST for action port [ 572.578596] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3006dbf1-a25c-4a26-be12-12c344f7d94f with Priority: HIGHEST for action port [ 572.578944] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-3006dbf1-a25c-4a26-be12-12c344f7d94f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.579082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3006dbf1-a25c-4a26-be12-12c344f7d94f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.579142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3006dbf1-a25c-4a26-be12-12c344f7d94f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.579429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3006dbf1-a25c-4a26-be12-12c344f7d94f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.579814] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3006dbf1-a25c-4a26-be12-12c344f7d94f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.808557] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.808985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.809130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.809411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.809553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.809822] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.810115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.810691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.810911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.811012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.811130] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 already deleted. [ 572.811216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.828226] env[63014]: INFO networking_nsxv3.common.synchronization [None req-fb21928e-f955-4b5e-989c-e15e22d1ba23 None None] Enqueued Resource ID: 8d85abaf-7165-412e-a20e-a9f924f7d7bc with Priority: HIGHEST for action port [ 572.828226] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d85abaf-7165-412e-a20e-a9f924f7d7bc with Priority: HIGHEST for action port [ 572.828226] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d85abaf-7165-412e-a20e-a9f924f7d7bc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.828226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d85abaf-7165-412e-a20e-a9f924f7d7bc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.828226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d85abaf-7165-412e-a20e-a9f924f7d7bc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.828226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d85abaf-7165-412e-a20e-a9f924f7d7bc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.828226] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d85abaf-7165-412e-a20e-a9f924f7d7bc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.866056] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: SUCCESS [ 572.866056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.866056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.866056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.866056] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.866056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.866056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.866056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.866056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.866056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.866056] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.042447] env[63014]: INFO networking_nsxv3.common.synchronization [req-a61736d7-9e3a-4a41-89d9-6a70c96d5d4b req-d5decaaf-696c-470b-acbe-13293639030d service nova] Enqueued Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGHEST for action security_group_rules [ 573.042447] env[63014]: INFO networking_nsxv3.common.synchronization [req-a61736d7-9e3a-4a41-89d9-6a70c96d5d4b req-d5decaaf-696c-470b-acbe-13293639030d service nova] Enqueued Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGHEST for action security_group_members [ 573.042447] env[63014]: INFO networking_nsxv3.common.synchronization [req-a61736d7-9e3a-4a41-89d9-6a70c96d5d4b req-d5decaaf-696c-470b-acbe-13293639030d service nova] Enqueued Resource ID: e038b344-b578-4e31-867d-0e2aa922d611 with Priority: HIGHEST for action port [ 573.042447] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGHEST for action security_group_rules [ 573.042447] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGHEST for action security_group_members [ 573.042447] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e038b344-b578-4e31-867d-0e2aa922d611 with Priority: HIGHEST for action port [ 573.044220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e5887-ef6d-4e88-a132-91dc117462bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.044329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.044395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.044674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.044838] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.045678] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e5887-ef6d-4e88-a132-91dc117462bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.045797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.045877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.046067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.046236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.046334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.046406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.046568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.046657] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.046757] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.052198] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e038b344-b578-4e31-867d-0e2aa922d611 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.052198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e038b344-b578-4e31-867d-0e2aa922d611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.052198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e038b344-b578-4e31-867d-0e2aa922d611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.052198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e038b344-b578-4e31-867d-0e2aa922d611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.052198] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e038b344-b578-4e31-867d-0e2aa922d611',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.086190] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3006dbf1-a25c-4a26-be12-12c344f7d94f [ 573.087327] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.088187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.088684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.090245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.090351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.090443] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3006dbf1-a25c-4a26-be12-12c344f7d94f already deleted. [ 573.090530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3006dbf1-a25c-4a26-be12-12c344f7d94f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.333320] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d85abaf-7165-412e-a20e-a9f924f7d7bc [ 573.333320] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.333320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.333320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.333663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.333663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.333756] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d85abaf-7165-412e-a20e-a9f924f7d7bc already deleted. [ 573.333756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d85abaf-7165-412e-a20e-a9f924f7d7bc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.337604] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.337604] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.337604] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.337604] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.337925] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.340404] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.340404] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.340404] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.340404] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.340404] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 573.340404] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 573.340404] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 573.340404] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 573.340404] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 573.340404] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 573.340404] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 573.360102] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 573.360380] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 573.360568] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 573.360754] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.361111] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-760975b1-1672-4af2-b2c2-c529cae82f23 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.361314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-760975b1-1672-4af2-b2c2-c529cae82f23" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.361487] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-760975b1-1672-4af2-b2c2-c529cae82f23" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.361754] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-760975b1-1672-4af2-b2c2-c529cae82f23" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.361907] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('760975b1-1672-4af2-b2c2-c529cae82f23',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.371789] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.371988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.372087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.372626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.372626] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.372765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.372873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.373161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.373260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.373384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.377357] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.377563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.377663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.377899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.378143] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.378303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.378384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.378639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.378855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.378983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.379405] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.551663] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e5887-ef6d-4e88-a132-91dc117462bb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.551889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.552157] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.554849] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e038b344-b578-4e31-867d-0e2aa922d611 with status ACTIVE [ 573.555267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.556057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.556057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.556057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.556296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.556543] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.556789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.556956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.557478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.557478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.557478] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.557612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.557643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.561762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.561762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.561762] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e038b344-b578-4e31-867d-0e2aa922d611 is going to be updated. [ 573.580606] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.582264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.582264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.582264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.582264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.582264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e038b344-b578-4e31-867d-0e2aa922d611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.871421] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.871731] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.871890] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.872927] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.873018] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.873375] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 760975b1-1672-4af2-b2c2-c529cae82f23 not found, creating... [ 573.873791] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.873975] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.874440] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.874440] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.874440] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.877443] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.877443] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.877443] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.877443] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.877443] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.877443] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 760975b1-1672-4af2-b2c2-c529cae82f23 is going to be created. [ 573.881436] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7989ce3f-24d4-41ad-b400-9895be68ebe4: rpc.has_security_group_logging(os_id): False [ 573.897229] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.897229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.897229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.897229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.898566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.898798] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.898912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.898975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.899224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.899263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.899464] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.899564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.899623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.899763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.899859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.901448] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.901563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.901620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.901808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.901920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.902844] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 is going to be created. [ 573.907478] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.907936] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.909143] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.909143] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.909143] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.909292] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-760975b1-1672-4af2-b2c2-c529cae82f23" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.019854] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.020015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.020086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.021097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.021327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.049027] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: IN_PROGRESS for 2s [ 574.057195] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.559691] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.559862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.559940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.560199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.560318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.560617] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e5887-ef6d-4e88-a132-91dc117462bb is going to be created. [ 574.586476] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.588819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.588819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.588819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.588819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.598500] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 333e5887-ef6d-4e88-a132-91dc117462bb in Status: UNINITIALIZED for 2s [ 575.120950] env[63014]: INFO networking_nsxv3.common.synchronization [None req-01d4d738-a35e-4996-ae83-19e7ac1d06ea None None] Enqueued Resource ID: fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2 with Priority: HIGHEST for action port [ 575.121953] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2 with Priority: HIGHEST for action port [ 575.122516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.122734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.122861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.123229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.126510] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.301274] env[63014]: INFO networking_nsxv3.common.synchronization [req-a8306ce3-db9d-45f8-ba5f-c5f2685ac948 req-7b4c6f21-7255-46a4-b6fb-e72fc3f4ba30 service nova] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_rules [ 575.301274] env[63014]: INFO networking_nsxv3.common.synchronization [req-a8306ce3-db9d-45f8-ba5f-c5f2685ac948 req-7b4c6f21-7255-46a4-b6fb-e72fc3f4ba30 service nova] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 575.301274] env[63014]: INFO networking_nsxv3.common.synchronization [req-a8306ce3-db9d-45f8-ba5f-c5f2685ac948 req-7b4c6f21-7255-46a4-b6fb-e72fc3f4ba30 service nova] Enqueued Resource ID: 760975b1-1672-4af2-b2c2-c529cae82f23 with Priority: HIGHEST for action port [ 575.301274] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_rules [ 575.301274] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 575.301274] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760975b1-1672-4af2-b2c2-c529cae82f23 with Priority: HIGHEST for action port [ 575.303073] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.304498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.304498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.304498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.304498] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.307166] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.307326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.307432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.307636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.307846] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.307959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.308050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.308361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.308464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.308563] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.312416] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-760975b1-1672-4af2-b2c2-c529cae82f23 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.312416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-760975b1-1672-4af2-b2c2-c529cae82f23" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.312416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-760975b1-1672-4af2-b2c2-c529cae82f23" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.312416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-760975b1-1672-4af2-b2c2-c529cae82f23" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.312416] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('760975b1-1672-4af2-b2c2-c529cae82f23',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.628985] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2 [ 575.628985] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.628985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.628985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.628985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.628985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.628985] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2 already deleted. [ 575.628985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdeb8bd8-fe86-4dc4-8e96-e1cf5de52fe2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.673983] env[63014]: INFO networking_nsxv3.common.synchronization [None req-8969703e-e055-4022-92ac-26d70289b5b0 tempest-ServersWithSpecificFlavorTestJSON-1510674973 tempest-ServersWithSpecificFlavorTestJSON-1510674973-project-member] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_rules [ 575.673983] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_rules [ 575.673983] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.673983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.673983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.673983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.673983] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.812751] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.812887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.813793] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.817025] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 760975b1-1672-4af2-b2c2-c529cae82f23 with status ACTIVE [ 575.817025] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.817194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.817314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.817501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.817591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.817781] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.817880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.817945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.818116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.818197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.818382] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.818827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.818918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.819103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.820106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.820106] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 760975b1-1672-4af2-b2c2-c529cae82f23 is going to be updated. [ 575.844262] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.844410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.844496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.845094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.845094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.845094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-760975b1-1672-4af2-b2c2-c529cae82f23" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.066640] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: SUCCESS [ 576.066881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.173713] env[63014]: INFO networking_nsxv3.common.synchronization [None req-bab67204-d5ee-4d0e-a903-828ba894c163 tempest-ServersWithSpecificFlavorTestJSON-1510674973 tempest-ServersWithSpecificFlavorTestJSON-1510674973-project-member] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_rules [ 576.177102] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_rules [ 576.178156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.178290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.194540] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.194540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.194540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.198138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.198138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.198138] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 already deleted. [ 576.198138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.198138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.198138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.198138] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.317034] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.503136] env[63014]: INFO networking_nsxv3.common.synchronization [req-4496362d-046d-4231-9272-f8163c57d3c6 req-208a3aa4-c25d-43b6-8ec7-901b6acbfdb8 tempest-ServersAdminTestJSON-1268263957 tempest-ServersAdminTestJSON-1268263957-project-member] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 576.503701] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 576.504014] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.504754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.504847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.505928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.505928] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.505928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.505928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.505928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.506110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.506110] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.607695] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 333e5887-ef6d-4e88-a132-91dc117462bb in Status: SUCCESS [ 576.607695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.607850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.608143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.608369] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.608562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.608675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.608869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.608987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.609092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.609317] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.720956] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.720956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.720956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.720956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.720956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.720956] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 already deleted. [ 576.720956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.820457] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.820622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.820731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.821067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.821252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.821369] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 is going to be created. [ 576.850317] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.850317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.850317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.850317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.850317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.858699] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: UNINITIALIZED for 2s [ 577.009779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.009779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.009779] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 already deleted. [ 577.009779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.084679] env[63014]: INFO networking_nsxv3.common.synchronization [None req-cc37c633-af84-47bc-8ce3-6450de787e65 None None] Enqueued Resource ID: d551e945-3ee2-4438-a126-82afffaea8f3 with Priority: HIGHEST for action port [ 577.084679] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d551e945-3ee2-4438-a126-82afffaea8f3 with Priority: HIGHEST for action port [ 577.086425] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-d551e945-3ee2-4438-a126-82afffaea8f3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.086566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d551e945-3ee2-4438-a126-82afffaea8f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.086642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d551e945-3ee2-4438-a126-82afffaea8f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.087631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d551e945-3ee2-4438-a126-82afffaea8f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.087718] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d551e945-3ee2-4438-a126-82afffaea8f3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.117023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e5887-ef6d-4e88-a132-91dc117462bb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.117023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.117023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e5887-ef6d-4e88-a132-91dc117462bb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.117023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.117023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.117865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.117865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.117865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.117865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.117865] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.364083] env[63014]: INFO networking_nsxv3.common.synchronization [None req-335ec686-13a9-406b-8752-49c308edb5de tempest-ServersV294TestFqdnHostnames-2073531531 tempest-ServersV294TestFqdnHostnames-2073531531-project-member] Enqueued Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_rules [ 577.365891] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_rules [ 577.366308] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.366461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.366506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.366871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.366908] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.592611] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d551e945-3ee2-4438-a126-82afffaea8f3 [ 577.593066] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.593163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.593163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.593644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.594012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.594553] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d551e945-3ee2-4438-a126-82afffaea8f3 already deleted. [ 577.594553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d551e945-3ee2-4438-a126-82afffaea8f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.624071] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 333e5887-ef6d-4e88-a132-91dc117462bb: rpc.has_security_group_logging(os_id): False [ 577.646528] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.646728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.646840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.647036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.647243] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.647357] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.647451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.647524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.647710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.647808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.648371] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.648371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.648371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.648371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.648651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.648651] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.648767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.648811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.649923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.649923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.649923] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e5887-ef6d-4e88-a132-91dc117462bb is going to be created. [ 577.761642] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.761958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.762179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.762547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.762744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.777628] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 333e5887-ef6d-4e88-a132-91dc117462bb in Status: IN_PROGRESS for 2s [ 577.887754] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.888025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.888091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.889141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.889141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.889141] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d19bea52-b73c-4d06-87a2-c45103884998 already deleted. [ 577.889141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.991798] env[63014]: INFO networking_nsxv3.common.synchronization [None req-f186696e-4de8-474a-9b70-ebd4ab82d354 tempest-ServersV294TestFqdnHostnames-2073531531 tempest-ServersV294TestFqdnHostnames-2073531531-project-member] Enqueued Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_rules [ 577.994683] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_rules [ 577.995055] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.995214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.995302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.996255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.996255] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.108156] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.108325] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.108325] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.108630] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.109239] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.111839] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.112055] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.112327] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.112570] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.112698] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 578.112816] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 578.112929] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 578.115980] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 578.115980] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 578.115980] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 578.115980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 578.135024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 578.135024] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 578.135024] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 578.135024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.135024] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-024f89f0-1a6a-4445-9ea1-6ce40508d999 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.135024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-024f89f0-1a6a-4445-9ea1-6ce40508d999" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.135024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-024f89f0-1a6a-4445-9ea1-6ce40508d999" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.135024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-024f89f0-1a6a-4445-9ea1-6ce40508d999" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.135024] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('024f89f0-1a6a-4445-9ea1-6ce40508d999',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.521243] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.521563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.521563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.521673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.521781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.521846] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d19bea52-b73c-4d06-87a2-c45103884998 already deleted. [ 578.521919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.646076] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.646076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.646076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.646076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.646076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.646076] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 024f89f0-1a6a-4445-9ea1-6ce40508d999 not found, creating... [ 578.646076] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.646076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.646076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.646076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.646076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.646473] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.646473] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.646473] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.646731] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.647100] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.647376] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 024f89f0-1a6a-4445-9ea1-6ce40508d999 is going to be created. [ 578.668123] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.668123] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.668123] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.669126] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.669126] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.669126] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-024f89f0-1a6a-4445-9ea1-6ce40508d999" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.872684] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: SUCCESS [ 578.873092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.874707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.874707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.874707] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.874707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.874707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.874707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.874707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.874707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.874707] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.188167] env[63014]: INFO networking_nsxv3.common.synchronization [req-f1f5d3ef-b5e2-43d0-b298-1b71d23243a8 req-66ada69c-75a7-4bcc-9761-b848e6053012 tempest-ServersAdminTestJSON-1268263957 tempest-ServersAdminTestJSON-1268263957-project-member] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 579.189139] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 579.190318] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.190318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.190394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.193899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.193899] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.193899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.193899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.193899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.193899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.193899] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.378059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.378224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.378295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.381687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.381687] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.381687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.381687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.381687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.381918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.381918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.382126] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.382126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.382287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.382918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.382918] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.382918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.382918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.382918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.382918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.382918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.383262] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.694074] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.694074] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.694074] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.696038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.696038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.696038] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.696038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.696247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.696379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.696499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.696548] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 already deleted. [ 579.696671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.791326] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 333e5887-ef6d-4e88-a132-91dc117462bb in Status: SUCCESS [ 579.791326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.885952] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db4cd683-9721-46bf-9f15-99f7cf241691: rpc.has_security_group_logging(os_id): False [ 579.903321] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.903509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.903579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.903791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.903878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.904301] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.904436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.904497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.904661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.904742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.904947] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.905115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.905115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.905248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.905322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.905509] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.905617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.905675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.905860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.905942] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.905976] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 is going to be created. [ 579.967870] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.967870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.967870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.967870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.967870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.971352] env[63014]: INFO networking_nsxv3.common.synchronization [None req-a458fc2e-541d-463c-8cd7-2ea5eafc5a04 None None] Enqueued Resource ID: 1594addb-3cda-4cb3-9fe3-1282488c2b75 with Priority: HIGHEST for action port [ 579.972989] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1594addb-3cda-4cb3-9fe3-1282488c2b75 with Priority: HIGHEST for action port [ 579.973274] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-1594addb-3cda-4cb3-9fe3-1282488c2b75 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.974608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1594addb-3cda-4cb3-9fe3-1282488c2b75" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.974608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1594addb-3cda-4cb3-9fe3-1282488c2b75" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.974739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1594addb-3cda-4cb3-9fe3-1282488c2b75" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.974828] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1594addb-3cda-4cb3-9fe3-1282488c2b75',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.977414] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: IN_PROGRESS for 2s [ 580.479072] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1594addb-3cda-4cb3-9fe3-1282488c2b75 [ 580.480210] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.480210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.480210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.480557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.480557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.480622] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1594addb-3cda-4cb3-9fe3-1282488c2b75 already deleted. [ 580.480660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1594addb-3cda-4cb3-9fe3-1282488c2b75" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.801357] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.801357] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.801357] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.801357] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.801754] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.801754] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.801754] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.801860] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.802945] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.803669] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 580.803889] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 580.804012] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 580.804133] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 580.804249] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 580.804381] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 580.804485] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 580.823961] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 580.824051] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 580.824848] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 580.824848] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.824848] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-0ac7126c-29e9-4754-9d65-d34843ac871f taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.825952] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-0ac7126c-29e9-4754-9d65-d34843ac871f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.825952] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-0ac7126c-29e9-4754-9d65-d34843ac871f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.825952] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-0ac7126c-29e9-4754-9d65-d34843ac871f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.825952] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ac7126c-29e9-4754-9d65-d34843ac871f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.834072] env[63014]: INFO networking_nsxv3.common.synchronization [req-4496362d-046d-4231-9272-f8163c57d3c6 req-e3c310b9-a00f-465e-9d4a-0280f2a12723 service nova] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_rules [ 580.834364] env[63014]: INFO networking_nsxv3.common.synchronization [req-4496362d-046d-4231-9272-f8163c57d3c6 req-e3c310b9-a00f-465e-9d4a-0280f2a12723 service nova] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 580.834527] env[63014]: INFO networking_nsxv3.common.synchronization [req-4496362d-046d-4231-9272-f8163c57d3c6 req-e3c310b9-a00f-465e-9d4a-0280f2a12723 service nova] Enqueued Resource ID: 024f89f0-1a6a-4445-9ea1-6ce40508d999 with Priority: HIGHEST for action port [ 580.837389] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_rules [ 580.837758] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 580.837758] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 024f89f0-1a6a-4445-9ea1-6ce40508d999 with Priority: HIGHEST for action port [ 580.841170] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.841170] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.841170] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.841170] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.841170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.841170] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.841932] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-024f89f0-1a6a-4445-9ea1-6ce40508d999 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.841932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-024f89f0-1a6a-4445-9ea1-6ce40508d999" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.841932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-024f89f0-1a6a-4445-9ea1-6ce40508d999" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.841932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-024f89f0-1a6a-4445-9ea1-6ce40508d999" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.842082] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('024f89f0-1a6a-4445-9ea1-6ce40508d999',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.331959] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.331959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.331959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.331959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.331959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.331959] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 0ac7126c-29e9-4754-9d65-d34843ac871f not found, creating... [ 581.331959] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.331959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.331959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.331959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.331959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.335050] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.335050] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.335050] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.335050] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.335050] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.335050] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 0ac7126c-29e9-4754-9d65-d34843ac871f is going to be created. [ 581.347221] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.347221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.347221] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 024f89f0-1a6a-4445-9ea1-6ce40508d999 with status ACTIVE [ 581.347221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.347221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.347221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.347733] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.347733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.347733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.349179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.349325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.349436] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 024f89f0-1a6a-4445-9ea1-6ce40508d999 is going to be updated. [ 581.356128] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.356314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.356433] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.360029] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.360029] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.360029] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-0ac7126c-29e9-4754-9d65-d34843ac871f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.372233] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.372351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.372456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.372782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.372782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.374271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-024f89f0-1a6a-4445-9ea1-6ce40508d999" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.662191] env[63014]: INFO networking_nsxv3.common.synchronization [req-676bb7a9-85a3-4080-aff6-7e48faf304f3 req-2d776745-afb1-49c8-aee5-ef054d001e88 tempest-VolumesAdminNegativeTest-1905375078 tempest-VolumesAdminNegativeTest-1905375078-project-member] Enqueued Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_members [ 581.662191] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_members [ 581.662817] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.663154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.663377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.663765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.664656] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.665032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.665199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.666852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.666852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.666852] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.853760] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.990210] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: SUCCESS [ 581.990765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.169258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.169733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.169964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.170377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.171227] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.174581] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.174581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.174581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.174581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.174581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.174581] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 already deleted. [ 582.174581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.312360] env[63014]: INFO networking_nsxv3.common.synchronization [None req-1822bbdd-b143-47ed-9c17-2efaee41bf13 None None] Enqueued Resource ID: 5f868fab-b54f-4b0c-b419-d870f0726e8f with Priority: HIGHEST for action port [ 582.312928] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f868fab-b54f-4b0c-b419-d870f0726e8f with Priority: HIGHEST for action port [ 582.313271] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f868fab-b54f-4b0c-b419-d870f0726e8f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.313780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f868fab-b54f-4b0c-b419-d870f0726e8f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.314614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f868fab-b54f-4b0c-b419-d870f0726e8f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.314901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f868fab-b54f-4b0c-b419-d870f0726e8f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.315018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f868fab-b54f-4b0c-b419-d870f0726e8f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.356556] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.356556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.356556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.356556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.356556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.356556] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be created. [ 582.380092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.380435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.380435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.380535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.380615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.391057] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: UNINITIALIZED for 2s [ 582.820594] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f868fab-b54f-4b0c-b419-d870f0726e8f [ 582.822480] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.822480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.822480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.822480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.822480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.822480] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f868fab-b54f-4b0c-b419-d870f0726e8f already deleted. [ 582.822480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f868fab-b54f-4b0c-b419-d870f0726e8f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.864244] env[63014]: INFO networking_nsxv3.common.synchronization [None req-38a85195-be77-46a9-8615-c1be80117cbc None None] Enqueued Resource ID: 6dec40d9-d9ac-4557-8a10-6eb66d8fb24d with Priority: HIGHEST for action port [ 582.864548] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dec40d9-d9ac-4557-8a10-6eb66d8fb24d with Priority: HIGHEST for action port [ 582.865102] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dec40d9-d9ac-4557-8a10-6eb66d8fb24d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.865237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dec40d9-d9ac-4557-8a10-6eb66d8fb24d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.865290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dec40d9-d9ac-4557-8a10-6eb66d8fb24d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.865529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dec40d9-d9ac-4557-8a10-6eb66d8fb24d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.865608] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dec40d9-d9ac-4557-8a10-6eb66d8fb24d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.370587] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dec40d9-d9ac-4557-8a10-6eb66d8fb24d [ 583.370587] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.370951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.370951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.372043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.372043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.372043] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dec40d9-d9ac-4557-8a10-6eb66d8fb24d already deleted. [ 583.372043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dec40d9-d9ac-4557-8a10-6eb66d8fb24d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.620773] env[63014]: INFO networking_nsxv3.common.synchronization [req-f1f5d3ef-b5e2-43d0-b298-1b71d23243a8 req-d4df4a1c-485b-4217-b44b-2d9a766e63e6 service nova] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_rules [ 583.621022] env[63014]: INFO networking_nsxv3.common.synchronization [req-f1f5d3ef-b5e2-43d0-b298-1b71d23243a8 req-d4df4a1c-485b-4217-b44b-2d9a766e63e6 service nova] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 583.621196] env[63014]: INFO networking_nsxv3.common.synchronization [req-f1f5d3ef-b5e2-43d0-b298-1b71d23243a8 req-d4df4a1c-485b-4217-b44b-2d9a766e63e6 service nova] Enqueued Resource ID: 0ac7126c-29e9-4754-9d65-d34843ac871f with Priority: HIGHEST for action port [ 583.621490] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_rules [ 583.621656] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 583.621781] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac7126c-29e9-4754-9d65-d34843ac871f with Priority: HIGHEST for action port [ 583.622916] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.623084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.623993] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.624144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.624371] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ac7126c-29e9-4754-9d65-d34843ac871f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.624941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ac7126c-29e9-4754-9d65-d34843ac871f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.624941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ac7126c-29e9-4754-9d65-d34843ac871f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.624941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ac7126c-29e9-4754-9d65-d34843ac871f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.624941] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ac7126c-29e9-4754-9d65-d34843ac871f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.749387] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-869 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.749593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-869" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.749694] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-869" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.750057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-869" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.750335] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.750507] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.750731] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.750954] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.751031] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.753887] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 583.753887] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.753887] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.753887] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.753887] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 583.753887] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.753887] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.771826] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.771826] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 583.771826] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.771826] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-869" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.772133] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.772133] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.772616] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.772616] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.772708] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('028ed35d-701a-4fc6-be3b-31fcdb71dcf1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.970541] env[63014]: INFO networking_nsxv3.common.synchronization [None req-0d7fc0b5-2965-4aea-a7f7-00dd805f36c8 None None] Enqueued Resource ID: bb941b06-dcf7-4077-988c-1e28c1b0ddd0 with Priority: HIGHEST for action port [ 583.970919] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb941b06-dcf7-4077-988c-1e28c1b0ddd0 with Priority: HIGHEST for action port [ 583.971380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb941b06-dcf7-4077-988c-1e28c1b0ddd0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.971500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb941b06-dcf7-4077-988c-1e28c1b0ddd0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.971575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb941b06-dcf7-4077-988c-1e28c1b0ddd0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.971876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb941b06-dcf7-4077-988c-1e28c1b0ddd0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.971876] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb941b06-dcf7-4077-988c-1e28c1b0ddd0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.015308] env[63014]: INFO networking_nsxv3.common.synchronization [None req-dff88186-0d96-4710-a4a8-b1ce16d73fec None None] Enqueued Resource ID: 3e6ec57d-4b03-4d3f-9063-6522cd1f0955 with Priority: HIGHEST for action port [ 584.015308] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e6ec57d-4b03-4d3f-9063-6522cd1f0955 with Priority: HIGHEST for action port [ 584.015308] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e6ec57d-4b03-4d3f-9063-6522cd1f0955 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.015308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e6ec57d-4b03-4d3f-9063-6522cd1f0955" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.015494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e6ec57d-4b03-4d3f-9063-6522cd1f0955" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.019022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e6ec57d-4b03-4d3f-9063-6522cd1f0955" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.019022] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6ec57d-4b03-4d3f-9063-6522cd1f0955',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.040916] env[63014]: INFO networking_nsxv3.common.synchronization [req-80c0a8bc-5aae-444c-9d45-eab359c4988c req-9b679a03-7e5d-41dd-adad-0fb5f21454b3 tempest-ServerDiagnosticsTest-1628797124 tempest-ServerDiagnosticsTest-1628797124-project-member] Enqueued Resource ID: 67b29187-e991-47a0-93b3-5a8f6f288242 with Priority: HIGHEST for action security_group_members [ 584.040916] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b29187-e991-47a0-93b3-5a8f6f288242 with Priority: HIGHEST for action security_group_members [ 584.040916] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b29187-e991-47a0-93b3-5a8f6f288242 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.040916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.040916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.040916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.040916] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.040916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.040916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.040916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.040916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.041890] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67b29187-e991-47a0-93b3-5a8f6f288242',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.131952] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ac7126c-29e9-4754-9d65-d34843ac871f with status ACTIVE [ 584.132250] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.132368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.132715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.133194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.133377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.133671] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.133671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.133937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.133937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.134092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.134193] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.134286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.134544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.134544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.134632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.136255] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ac7126c-29e9-4754-9d65-d34843ac871f is going to be updated. [ 584.159410] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.159410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.159410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.159410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.159410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.159410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ac7126c-29e9-4754-9d65-d34843ac871f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.275815] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.276125] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.276279] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.276540] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.276686] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.276836] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 028ed35d-701a-4fc6-be3b-31fcdb71dcf1 not found, creating... [ 584.277161] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.277376] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.277376] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.277653] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.277721] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.278394] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.278394] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.278394] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.278569] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.278569] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.278893] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 028ed35d-701a-4fc6-be3b-31fcdb71dcf1 is going to be created. [ 584.306103] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.306103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.306103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.306103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.306103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.306364] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.405071] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 584.405374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.405463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.405641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.405830] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.405946] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.406017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.406179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.406264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.406342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.406563] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.409297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.409297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.409297] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.409297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.409297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.409297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.409297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.409297] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.478191] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb941b06-dcf7-4077-988c-1e28c1b0ddd0 [ 584.478191] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.478191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.478191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.478191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.478191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.478191] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb941b06-dcf7-4077-988c-1e28c1b0ddd0 already deleted. [ 584.478191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb941b06-dcf7-4077-988c-1e28c1b0ddd0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.520592] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e6ec57d-4b03-4d3f-9063-6522cd1f0955 [ 584.520830] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.520977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.521066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.521408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.521408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.521473] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e6ec57d-4b03-4d3f-9063-6522cd1f0955 already deleted. [ 584.521606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e6ec57d-4b03-4d3f-9063-6522cd1f0955" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.551019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.551019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.551019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67b29187-e991-47a0-93b3-5a8f6f288242 already deleted. [ 584.551019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.914017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.914017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.914017] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.969641] env[63014]: INFO networking_nsxv3.common.synchronization [None req-2cff8129-fabe-4480-9833-9233c6e38b03 None None] Enqueued Resource ID: ffc7be99-77e1-427b-9db2-716b91c277ba with Priority: HIGHEST for action port [ 584.969641] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffc7be99-77e1-427b-9db2-716b91c277ba with Priority: HIGHEST for action port [ 584.969641] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffc7be99-77e1-427b-9db2-716b91c277ba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.969641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffc7be99-77e1-427b-9db2-716b91c277ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.969641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffc7be99-77e1-427b-9db2-716b91c277ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.969641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffc7be99-77e1-427b-9db2-716b91c277ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.969641] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffc7be99-77e1-427b-9db2-716b91c277ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.415902] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.470970] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffc7be99-77e1-427b-9db2-716b91c277ba [ 585.471328] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.472332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.472332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.472332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.472332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.472332] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffc7be99-77e1-427b-9db2-716b91c277ba already deleted. [ 585.472332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffc7be99-77e1-427b-9db2-716b91c277ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.812991] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.812991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.812991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.812991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.812991] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.812991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.812991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.812991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.812991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.812991] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.812991] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.812991] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.812991] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.813661] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.813661] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.813661] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.831171] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.831171] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 585.831171] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.831171] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.835021] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.835021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.835021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.835021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.835021] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab9e93fc-cc78-44bd-a8cf-713a8b05475b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.919375] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.919375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.923256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.923256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.923256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.923256] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 585.961551] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.963886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.963886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.964113] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.964284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.972186] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 586.136404] env[63014]: INFO networking_nsxv3.common.synchronization [req-676bb7a9-85a3-4080-aff6-7e48faf304f3 req-473ffa75-0ff1-4428-a68b-6b1e8ad27ef8 service nova] Enqueued Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_rules [ 586.137968] env[63014]: INFO networking_nsxv3.common.synchronization [req-676bb7a9-85a3-4080-aff6-7e48faf304f3 req-473ffa75-0ff1-4428-a68b-6b1e8ad27ef8 service nova] Enqueued Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_members [ 586.138152] env[63014]: INFO networking_nsxv3.common.synchronization [req-676bb7a9-85a3-4080-aff6-7e48faf304f3 req-473ffa75-0ff1-4428-a68b-6b1e8ad27ef8 service nova] Enqueued Resource ID: 028ed35d-701a-4fc6-be3b-31fcdb71dcf1 with Priority: HIGHEST for action port [ 586.138437] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_rules [ 586.138529] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_members [ 586.138622] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 028ed35d-701a-4fc6-be3b-31fcdb71dcf1 with Priority: HIGHEST for action port [ 586.141951] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.142170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.142170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.142385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.142469] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.143444] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.143558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.143705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.143827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.144084] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.144084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.144084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.144226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.144329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.144418] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.145760] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.145842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.145984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.146205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.146335] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('028ed35d-701a-4fc6-be3b-31fcdb71dcf1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.337625] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.337625] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.337625] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.337625] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.337625] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.337625] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port ab9e93fc-cc78-44bd-a8cf-713a8b05475b not found, creating... [ 586.339685] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.339959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.340398] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.340487] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.341061] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.341170] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.341307] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.341425] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.341739] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.341934] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.342173] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: ab9e93fc-cc78-44bd-a8cf-713a8b05475b is going to be created. [ 586.365761] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.365982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.366219] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.366533] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.367382] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.367382] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.645725] env[63014]: INFO networking_nsxv3.common.synchronization [None req-fa349424-3de5-48f7-9d9e-88c70a6891a5 None None] Enqueued Resource ID: 6599606b-499f-48de-bfd5-76bf2f48d84c with Priority: HIGHEST for action port [ 586.645725] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6599606b-499f-48de-bfd5-76bf2f48d84c with Priority: HIGHEST for action port [ 586.646483] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6599606b-499f-48de-bfd5-76bf2f48d84c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.646789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6599606b-499f-48de-bfd5-76bf2f48d84c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.649325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6599606b-499f-48de-bfd5-76bf2f48d84c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.649325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6599606b-499f-48de-bfd5-76bf2f48d84c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.649325] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6599606b-499f-48de-bfd5-76bf2f48d84c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.649325] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.649868] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.650174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.650512] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 028ed35d-701a-4fc6-be3b-31fcdb71dcf1 with status ACTIVE [ 586.650697] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.650808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.650919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.651141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.651291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.651488] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.651617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.651653] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.651871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.651914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.652813] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.652813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.652813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.652813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.652813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.652813] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 028ed35d-701a-4fc6-be3b-31fcdb71dcf1 is going to be updated. [ 586.678448] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.678448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.678448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.678708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.678982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.679120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-028ed35d-701a-4fc6-be3b-31fcdb71dcf1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.835596] env[63014]: INFO networking_nsxv3.common.synchronization [req-e9cec7d7-51d1-4e9b-a609-5b628c65a7c4 req-917d27a1-7499-4fe4-97df-ee8c8149a4c9 tempest-ServerDiagnosticsNegativeTest-1963020951 tempest-ServerDiagnosticsNegativeTest-1963020951-project-member] Enqueued Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGHEST for action security_group_members [ 586.836113] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGHEST for action security_group_members [ 586.836412] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ab69c49-5404-4dd4-a6d3-4fce8969088a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.836655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.836655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.836929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.836990] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.838186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.838186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.838186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.838186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.838186] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.149995] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6599606b-499f-48de-bfd5-76bf2f48d84c [ 587.150354] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.150453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.150453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.150674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.150762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.150859] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6599606b-499f-48de-bfd5-76bf2f48d84c already deleted. [ 587.150936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6599606b-499f-48de-bfd5-76bf2f48d84c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.151512] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.342380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.342380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.342380] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a already deleted. [ 587.342380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.456493] env[63014]: INFO networking_nsxv3.common.synchronization [None req-515e4cc6-9bc7-4333-acd1-1c74221fc5c5 None None] Enqueued Resource ID: 6989dd82-8694-47f6-b6a2-21070099b0cf with Priority: HIGHEST for action port [ 587.456493] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6989dd82-8694-47f6-b6a2-21070099b0cf with Priority: HIGHEST for action port [ 587.456668] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6989dd82-8694-47f6-b6a2-21070099b0cf taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.457027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6989dd82-8694-47f6-b6a2-21070099b0cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.457027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6989dd82-8694-47f6-b6a2-21070099b0cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.457252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6989dd82-8694-47f6-b6a2-21070099b0cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.457252] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6989dd82-8694-47f6-b6a2-21070099b0cf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.653679] env[63014]: INFO networking_nsxv3.common.synchronization [req-80c0a8bc-5aae-444c-9d45-eab359c4988c req-4981795b-92fb-49be-a137-73a756c009f4 service nova] Enqueued Resource ID: 67b29187-e991-47a0-93b3-5a8f6f288242 with Priority: HIGHEST for action security_group_rules [ 587.654035] env[63014]: INFO networking_nsxv3.common.synchronization [req-80c0a8bc-5aae-444c-9d45-eab359c4988c req-4981795b-92fb-49be-a137-73a756c009f4 service nova] Enqueued Resource ID: 67b29187-e991-47a0-93b3-5a8f6f288242 with Priority: HIGHEST for action security_group_members [ 587.654035] env[63014]: INFO networking_nsxv3.common.synchronization [req-80c0a8bc-5aae-444c-9d45-eab359c4988c req-4981795b-92fb-49be-a137-73a756c009f4 service nova] Enqueued Resource ID: ab9e93fc-cc78-44bd-a8cf-713a8b05475b with Priority: HIGHEST for action port [ 587.654246] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b29187-e991-47a0-93b3-5a8f6f288242 with Priority: HIGHEST for action security_group_rules [ 587.654393] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b29187-e991-47a0-93b3-5a8f6f288242 with Priority: HIGHEST for action security_group_members [ 587.654486] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab9e93fc-cc78-44bd-a8cf-713a8b05475b with Priority: HIGHEST for action port [ 587.655099] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67b29187-e991-47a0-93b3-5a8f6f288242 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.655253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.655325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.655554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.655656] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67b29187-e991-47a0-93b3-5a8f6f288242',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.656743] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b29187-e991-47a0-93b3-5a8f6f288242 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.656866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.656934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.657104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.657268] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.657367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.657422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.657562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.657644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.657730] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67b29187-e991-47a0-93b3-5a8f6f288242',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.658461] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.658563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.658632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.658772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.658841] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab9e93fc-cc78-44bd-a8cf-713a8b05475b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.659866] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.659985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.660068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.660189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.660277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.660365] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 is going to be created. [ 587.696354] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.696354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.696354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.696354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.696354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.705234] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.705444] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.705600] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.705807] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.706065] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.706214] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.706325] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.706531] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.706667] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.706907] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 587.706968] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.708303] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.708444] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.708623] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 587.708665] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.708799] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.713873] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 in Status: UNINITIALIZED for 2s [ 587.729271] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.729416] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 587.729508] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.730809] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.730809] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-4bf2f744-8a93-4557-9e12-0e855756f7fc taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.730809] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-4bf2f744-8a93-4557-9e12-0e855756f7fc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.730809] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-4bf2f744-8a93-4557-9e12-0e855756f7fc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.730809] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-4bf2f744-8a93-4557-9e12-0e855756f7fc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.730809] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bf2f744-8a93-4557-9e12-0e855756f7fc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.962598] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6989dd82-8694-47f6-b6a2-21070099b0cf [ 587.962911] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.963105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.963202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.963488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.963610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.963736] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6989dd82-8694-47f6-b6a2-21070099b0cf already deleted. [ 587.963846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6989dd82-8694-47f6-b6a2-21070099b0cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.982531] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 587.983038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.983284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.983829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.983829] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.983829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.984073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.984112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.984414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.984414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.984514] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.986085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.986085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.986085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.986085] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.986311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.986311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.986379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.986426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.986508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.986800] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.032054] env[63014]: INFO networking_nsxv3.common.synchronization [None req-7dd116b2-12b8-44ec-aad8-50fd6f8681ad None None] Enqueued Resource ID: ead879d5-a65b-4765-af72-20e1ee39f7d1 with Priority: HIGHEST for action port [ 588.032558] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ead879d5-a65b-4765-af72-20e1ee39f7d1 with Priority: HIGHEST for action port [ 588.033176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ead879d5-a65b-4765-af72-20e1ee39f7d1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.033176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ead879d5-a65b-4765-af72-20e1ee39f7d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.033176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ead879d5-a65b-4765-af72-20e1ee39f7d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.033451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ead879d5-a65b-4765-af72-20e1ee39f7d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.033517] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ead879d5-a65b-4765-af72-20e1ee39f7d1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.162042] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b29187-e991-47a0-93b3-5a8f6f288242 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.162042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.162042] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67b29187-e991-47a0-93b3-5a8f6f288242',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.166731] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab9e93fc-cc78-44bd-a8cf-713a8b05475b with status ACTIVE [ 588.167571] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.167897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.168085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.168497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.168699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.169040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.169296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.170250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.170669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.172207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.173463] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.173463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.173463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.174502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.174723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.175154] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab9e93fc-cc78-44bd-a8cf-713a8b05475b is going to be updated. [ 588.196882] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.198323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.198464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.198767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.198924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.199114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab9e93fc-cc78-44bd-a8cf-713a8b05475b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.233850] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.234160] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.234256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.235109] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.235109] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.235109] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 4bf2f744-8a93-4557-9e12-0e855756f7fc not found, creating... [ 588.235376] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.235376] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.235483] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.235735] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.236042] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.237083] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.237083] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.237083] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.237083] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.237083] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.237083] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 4bf2f744-8a93-4557-9e12-0e855756f7fc is going to be created. [ 588.260272] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.260272] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.260272] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.260272] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.260272] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.260685] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-4bf2f744-8a93-4557-9e12-0e855756f7fc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.286076] env[63014]: INFO networking_nsxv3.common.synchronization [req-898630dd-c6b4-4587-a4c7-e685c166ae12 req-21330d98-123c-4747-922c-cd889857b8ef tempest-VolumesAssistedSnapshotsTest-148737378 tempest-VolumesAssistedSnapshotsTest-148737378-project-member] Enqueued Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_members [ 588.287143] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_members [ 588.287499] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.287671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.287671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.287996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.288170] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.288300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.288370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.288912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.289041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.289140] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.489424] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b31bea8a-6eb8-474e-9f80-c659e23a5477: rpc.has_security_group_logging(os_id): False [ 588.510351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.510351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.510351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.510351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.510351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.510569] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.510569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.510654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.510773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.511027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.511096] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.511157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.511190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.511374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.511453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.511635] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.511728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.511788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.511927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.512011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.513029] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be created. [ 588.535232] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ead879d5-a65b-4765-af72-20e1ee39f7d1 [ 588.535995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.535995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.535995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.535995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.536232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.539736] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ead879d5-a65b-4765-af72-20e1ee39f7d1 already deleted. [ 588.539736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ead879d5-a65b-4765-af72-20e1ee39f7d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.560103] env[63014]: INFO networking_nsxv3.common.synchronization [None req-2ec961fd-690b-4f7b-9275-1e69613f02d6 None None] Enqueued Resource ID: 6d933886-2de3-47a8-9a4d-967ade8e9670 with Priority: HIGHEST for action port [ 588.560375] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d933886-2de3-47a8-9a4d-967ade8e9670 with Priority: HIGHEST for action port [ 588.560981] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d933886-2de3-47a8-9a4d-967ade8e9670 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.561112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d933886-2de3-47a8-9a4d-967ade8e9670" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.561182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d933886-2de3-47a8-9a4d-967ade8e9670" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.561490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d933886-2de3-47a8-9a4d-967ade8e9670" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.561570] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d933886-2de3-47a8-9a4d-967ade8e9670',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.567410] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.567831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.567831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.567831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.568044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.580044] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 588.664563] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67b29187-e991-47a0-93b3-5a8f6f288242',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.786024] env[63014]: INFO networking_nsxv3.common.synchronization [None req-6e7c38f4-ce36-4936-8cb9-0f0da3b1bc5e None None] Enqueued Resource ID: ffe08d48-222a-413a-9d53-40974f14f928 with Priority: HIGHEST for action port [ 588.786388] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ffe08d48-222a-413a-9d53-40974f14f928 with Priority: HIGHEST for action port [ 588.787657] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ffe08d48-222a-413a-9d53-40974f14f928 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.787807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ffe08d48-222a-413a-9d53-40974f14f928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.787807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ffe08d48-222a-413a-9d53-40974f14f928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.788078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ffe08d48-222a-413a-9d53-40974f14f928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.788170] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ffe08d48-222a-413a-9d53-40974f14f928',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.793028] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.793185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.793259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.793481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.793569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.793762] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.793854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.793911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.794068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.794734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.794734] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 already deleted. [ 588.794734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.065439] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d933886-2de3-47a8-9a4d-967ade8e9670 [ 589.065566] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.065726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.065789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.066094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.066292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.066292] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d933886-2de3-47a8-9a4d-967ade8e9670 already deleted. [ 589.066367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d933886-2de3-47a8-9a4d-967ade8e9670" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.171439] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.171703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.171703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.172885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.172885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.172885] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67b29187-e991-47a0-93b3-5a8f6f288242 is going to be created. [ 589.197885] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.197885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.197885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.198287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.198443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.209797] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67b29187-e991-47a0-93b3-5a8f6f288242 in Status: UNINITIALIZED for 2s [ 589.249232] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.249232] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-545" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.255021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-545" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.255021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-545" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.255021] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.255021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.255021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.255021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.255021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.255021] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.255021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 589.255021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 589.255021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 589.255021] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 589.255021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 589.255021] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 589.272552] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 589.272796] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 589.272957] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 589.273209] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-545" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.273664] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-f3c562db-e980-4d13-b8d5-edd035642f76 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.274069] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-f3c562db-e980-4d13-b8d5-edd035642f76" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.274317] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-f3c562db-e980-4d13-b8d5-edd035642f76" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.275403] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-f3c562db-e980-4d13-b8d5-edd035642f76" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.275403] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c562db-e980-4d13-b8d5-edd035642f76',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.291415] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ffe08d48-222a-413a-9d53-40974f14f928 [ 589.291415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.291415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.291415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.291415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.291415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.292168] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ffe08d48-222a-413a-9d53-40974f14f928 already deleted. [ 589.292168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ffe08d48-222a-413a-9d53-40974f14f928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.521344] env[63014]: INFO networking_nsxv3.common.synchronization [req-e9cec7d7-51d1-4e9b-a609-5b628c65a7c4 req-e8001e05-d279-4d9c-9d97-5ca67045d232 service nova] Enqueued Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGHEST for action security_group_rules [ 589.521541] env[63014]: INFO networking_nsxv3.common.synchronization [req-e9cec7d7-51d1-4e9b-a609-5b628c65a7c4 req-e8001e05-d279-4d9c-9d97-5ca67045d232 service nova] Enqueued Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGHEST for action security_group_members [ 589.521680] env[63014]: INFO networking_nsxv3.common.synchronization [req-e9cec7d7-51d1-4e9b-a609-5b628c65a7c4 req-e8001e05-d279-4d9c-9d97-5ca67045d232 service nova] Enqueued Resource ID: 4bf2f744-8a93-4557-9e12-0e855756f7fc with Priority: HIGHEST for action port [ 589.522845] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGHEST for action security_group_rules [ 589.523583] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGHEST for action security_group_members [ 589.523748] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf2f744-8a93-4557-9e12-0e855756f7fc with Priority: HIGHEST for action port [ 589.524053] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.524244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.524318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.524697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.524789] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.526104] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ab69c49-5404-4dd4-a6d3-4fce8969088a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.526228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.526300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.526507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.526670] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.526768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.526822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.526967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.527071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.527164] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.528246] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bf2f744-8a93-4557-9e12-0e855756f7fc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.528346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bf2f744-8a93-4557-9e12-0e855756f7fc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.529186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bf2f744-8a93-4557-9e12-0e855756f7fc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.529327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bf2f744-8a93-4557-9e12-0e855756f7fc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.529327] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bf2f744-8a93-4557-9e12-0e855756f7fc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.726079] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 in Status: SUCCESS [ 589.726316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.726473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.726986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.726986] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.727143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.727143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.727320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.727432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.727535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.727626] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.777644] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.777864] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.777988] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.778281] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.778429] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.778578] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port f3c562db-e980-4d13-b8d5-edd035642f76 not found, creating... [ 589.778825] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.778989] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.779152] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.780456] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.780456] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.780456] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.780456] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.780456] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.780778] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.780814] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.781023] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: f3c562db-e980-4d13-b8d5-edd035642f76 is going to be created. [ 589.802400] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.802628] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.802777] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.803794] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.803794] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.803794] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-f3c562db-e980-4d13-b8d5-edd035642f76" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.839915] env[63014]: INFO networking_nsxv3.common.synchronization [req-bbdd4a2d-e4d7-4a38-92bb-04fd72aa60e5 req-0e2b888f-fd46-436c-ae3b-2251ebf87941 tempest-SecurityGroupRulesNegativeTestJSON-1783017906 tempest-SecurityGroupRulesNegativeTestJSON-1783017906-project-member] Enqueued Resource ID: b997ff7f-1d64-47d2-92f2-a51562a9cd0f with Priority: HIGHEST for action security_group_rules [ 589.839915] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b997ff7f-1d64-47d2-92f2-a51562a9cd0f with Priority: HIGHEST for action security_group_rules [ 589.839915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.839915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.839915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.839915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.839915] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b997ff7f-1d64-47d2-92f2-a51562a9cd0f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.032993] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.037804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ab69c49-5404-4dd4-a6d3-4fce8969088a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.037804] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bf2f744-8a93-4557-9e12-0e855756f7fc with status ACTIVE [ 590.037804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.037804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.037804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.037804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.038556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.038556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.038556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.038556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.038556] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bf2f744-8a93-4557-9e12-0e855756f7fc is going to be updated. [ 590.057922] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.058184] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.058267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.058932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.058932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.058932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bf2f744-8a93-4557-9e12-0e855756f7fc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.150354] env[63014]: INFO networking_nsxv3.common.synchronization [None req-38f80faa-baa6-4af3-9a28-afcd40d12947 None None] Enqueued Resource ID: 696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2 with Priority: HIGHEST for action port [ 590.150472] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2 with Priority: HIGHEST for action port [ 590.150844] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.153344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.153493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.153941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.154069] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.230446] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.363735] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.363735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.363735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.363735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.363735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.363735] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b997ff7f-1d64-47d2-92f2-a51562a9cd0f already deleted. [ 590.363735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.539743] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.591243] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 590.591899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.591899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.592078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.592078] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.656525] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2 [ 590.656775] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.656911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.657101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.657245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.657451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.657530] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2 already deleted. [ 590.657614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-696bbfe9-6cd7-4e57-ab4d-20b1e1d1c2d2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.704889] env[63014]: INFO networking_nsxv3.common.synchronization [req-2b9828c5-50c0-48a8-b0e3-df7252834aec req-495f939a-6cdc-46ec-b510-945f628ca242 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 590.706047] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 590.706047] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.706188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.706188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.706441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.706822] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.706822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.706822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.706986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.706986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.707749] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.731489] env[63014]: INFO networking_nsxv3.common.synchronization [req-898630dd-c6b4-4587-a4c7-e685c166ae12 req-ab2f278d-453b-475a-8a8d-2654d2093916 service nova] Enqueued Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_rules [ 590.731771] env[63014]: INFO networking_nsxv3.common.synchronization [req-898630dd-c6b4-4587-a4c7-e685c166ae12 req-ab2f278d-453b-475a-8a8d-2654d2093916 service nova] Enqueued Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_members [ 590.731855] env[63014]: INFO networking_nsxv3.common.synchronization [req-898630dd-c6b4-4587-a4c7-e685c166ae12 req-ab2f278d-453b-475a-8a8d-2654d2093916 service nova] Enqueued Resource ID: f3c562db-e980-4d13-b8d5-edd035642f76 with Priority: HIGHEST for action port [ 590.732357] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_rules [ 590.732677] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_members [ 590.732677] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3c562db-e980-4d13-b8d5-edd035642f76 with Priority: HIGHEST for action port [ 590.732784] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a7dcf68e-77c7-4c96-8393-9ad6248f6c31: rpc.has_security_group_logging(os_id): False [ 590.734054] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.734054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.734182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.734314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.734384] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.735170] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.735290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.735359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.735531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.735705] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.735803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.735864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.736030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.737187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.737287] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.738155] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3c562db-e980-4d13-b8d5-edd035642f76 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.738273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3c562db-e980-4d13-b8d5-edd035642f76" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.738341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3c562db-e980-4d13-b8d5-edd035642f76" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.738513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3c562db-e980-4d13-b8d5-edd035642f76" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.738589] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3c562db-e980-4d13-b8d5-edd035642f76',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.755860] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.756027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.756027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.756513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.756513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.756513] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.756691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.756691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.756792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.756868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.756953] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 is going to be created. [ 590.819239] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.819392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.819463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.819674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.819855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.829998] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 in Status: IN_PROGRESS for 2s [ 591.045635] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.045635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.045635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.045635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.045635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.045635] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a is going to be created. [ 591.065077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.065241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.065313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.065540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.065714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.075566] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a in Status: UNINITIALIZED for 2s [ 591.096105] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.099188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.099188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.099188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.099188] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.099188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.099188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.099188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.099188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.099188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.099188] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.176670] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.176670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.176670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.176670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.176670] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.176670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.176670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.176670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.176670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.176670] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 591.177230] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.177551] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.177906] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.177906] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 591.177906] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.178900] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.198142] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.199666] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 591.199666] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.199666] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.200092] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-fd403c04-a16c-46b9-a6f8-e9ed371d0624 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.200331] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-fd403c04-a16c-46b9-a6f8-e9ed371d0624" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.200507] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-fd403c04-a16c-46b9-a6f8-e9ed371d0624" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.200988] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-fd403c04-a16c-46b9-a6f8-e9ed371d0624" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.201250] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd403c04-a16c-46b9-a6f8-e9ed371d0624',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.210688] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.210916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.210916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.211826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.211826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.211826] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.211826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.211826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.211826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.212321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.212321] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b44cf44-3516-4644-9659-498297843d9a already deleted. [ 591.212321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.227979] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67b29187-e991-47a0-93b3-5a8f6f288242 in Status: SUCCESS [ 591.227979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.227979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.227979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.227979] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.228595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.228595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.228595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.228595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.228595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.228595] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67b29187-e991-47a0-93b3-5a8f6f288242',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.243579] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.243732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.243959] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.246750] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3c562db-e980-4d13-b8d5-edd035642f76 with status ACTIVE [ 591.246750] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.246750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.246750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.246750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.246750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.246750] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.246750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.246750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.247077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.247077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.247220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.247267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.247366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.247450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.247500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.247584] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3c562db-e980-4d13-b8d5-edd035642f76 is going to be updated. [ 591.268460] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.268460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.268460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.268696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.268696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.269375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3c562db-e980-4d13-b8d5-edd035642f76" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.602546] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.602827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.602827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.603052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.603206] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.603396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.603396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.603869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.603869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.603869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.603869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.604394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.604394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.604394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.604394] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.604394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.604718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.604718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.604718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.604718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.604914] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.635460] env[63014]: INFO networking_nsxv3.common.synchronization [req-5fb65518-0ba5-481e-bb3d-baf5324f319e req-0db28a6e-f8e0-4513-b74f-831fe733bcaf tempest-DeleteServersAdminTestJSON-1022743666 tempest-DeleteServersAdminTestJSON-1022743666-project-admin] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 591.635460] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 591.636082] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.636082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.638139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.638447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.638764] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.638933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.639037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.639305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.639398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.639520] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.703750] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.704163] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.704299] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.704605] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.704780] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.704959] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port fd403c04-a16c-46b9-a6f8-e9ed371d0624 not found, creating... [ 591.705295] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.705468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.705757] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.705871] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.705972] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.706300] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.706473] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.706596] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.706839] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.706982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.707153] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: fd403c04-a16c-46b9-a6f8-e9ed371d0624 is going to be created. [ 591.729970] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.730314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.730515] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.730826] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.731429] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.731532] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-fd403c04-a16c-46b9-a6f8-e9ed371d0624" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.732667] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b29187-e991-47a0-93b3-5a8f6f288242 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.732827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.732930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.733222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.733673] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.733673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.733673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.733898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.733952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.734058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.734224] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b29187-e991-47a0-93b3-5a8f6f288242 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.734364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.734492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.734654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.734847] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.734967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.735059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.735268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.735390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.735529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.735916] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67b29187-e991-47a0-93b3-5a8f6f288242',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.752084] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.031856] env[63014]: INFO networking_nsxv3.common.synchronization [None req-5e31d414-e4cb-4129-8961-fc0d4ab4a830 None None] Enqueued Resource ID: aaa0ab94-61be-46b1-ab23-5e9df211ffce with Priority: HIGHEST for action port [ 592.032156] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaa0ab94-61be-46b1-ab23-5e9df211ffce with Priority: HIGHEST for action port [ 592.032736] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaa0ab94-61be-46b1-ab23-5e9df211ffce taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.032866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaa0ab94-61be-46b1-ab23-5e9df211ffce" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.032934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaa0ab94-61be-46b1-ab23-5e9df211ffce" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.033203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaa0ab94-61be-46b1-ab23-5e9df211ffce" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.033315] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaa0ab94-61be-46b1-ab23-5e9df211ffce',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.109024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b31bea8a-6eb8-474e-9f80-c659e23a5477: rpc.has_security_group_logging(os_id): False [ 592.130261] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.130456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.130505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.130696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.130791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.130977] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.131083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.131183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.131316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.131397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.131631] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.131755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.131794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.132416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.132416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.132416] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.132416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.132416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.133451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.133451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.133451] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 592.141450] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.141632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.141689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.141911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.141961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.142170] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.142347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.142347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.142547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.142723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.142802] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 is going to be updated. [ 592.166811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.167037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.167037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.167837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.167837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.175798] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: IN_PROGRESS for 2s [ 592.196024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.196024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.196024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.196293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.196329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.209133] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 592.238520] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67b29187-e991-47a0-93b3-5a8f6f288242: rpc.has_security_group_logging(os_id): False [ 592.258132] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.258132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.258132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.258132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.258132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.258405] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 is going to be created. [ 592.267376] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.267376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.267549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.267624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.268022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.268022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.268022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.268462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.268462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.268462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.268639] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.268639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.268717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.273022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.273022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.273022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.273022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.273022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.273022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.273022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.273022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67b29187-e991-47a0-93b3-5a8f6f288242 is going to be created. [ 592.292688] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.292842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.292904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.293130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.293308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.303269] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 in Status: UNINITIALIZED for 2s [ 592.345056] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.345056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.345056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.345056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.345056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.354278] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67b29187-e991-47a0-93b3-5a8f6f288242 in Status: IN_PROGRESS for 2s [ 592.365195] env[63014]: INFO networking_nsxv3.common.synchronization [req-9c28e5da-340a-477c-b42c-3a30aa8bf10e req-19b4848f-9f65-42b2-8019-1b39183663ec tempest-SecurityGroupRulesTestJSON-299309072 tempest-SecurityGroupRulesTestJSON-299309072-project-member] Enqueued Resource ID: 538155ed-ab13-4f7a-b3b5-bfff4be7b046 with Priority: HIGHEST for action security_group_rules [ 592.365195] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538155ed-ab13-4f7a-b3b5-bfff4be7b046 with Priority: HIGHEST for action security_group_rules [ 592.365438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-538155ed-ab13-4f7a-b3b5-bfff4be7b046 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.365567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-538155ed-ab13-4f7a-b3b5-bfff4be7b046" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.365651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-538155ed-ab13-4f7a-b3b5-bfff4be7b046" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.365906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-538155ed-ab13-4f7a-b3b5-bfff4be7b046" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.366296] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('538155ed-ab13-4f7a-b3b5-bfff4be7b046',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.535907] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaa0ab94-61be-46b1-ab23-5e9df211ffce [ 592.536468] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.536468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.536468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.536468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.536650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.536650] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaa0ab94-61be-46b1-ab23-5e9df211ffce already deleted. [ 592.536726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaa0ab94-61be-46b1-ab23-5e9df211ffce" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.614478] env[63014]: INFO networking_nsxv3.common.synchronization [req-2b9828c5-50c0-48a8-b0e3-df7252834aec req-46b2f9c6-1782-4036-91f7-904a6026c0c7 service nova] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_rules [ 592.614683] env[63014]: INFO networking_nsxv3.common.synchronization [req-2b9828c5-50c0-48a8-b0e3-df7252834aec req-46b2f9c6-1782-4036-91f7-904a6026c0c7 service nova] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 592.614770] env[63014]: INFO networking_nsxv3.common.synchronization [req-2b9828c5-50c0-48a8-b0e3-df7252834aec req-46b2f9c6-1782-4036-91f7-904a6026c0c7 service nova] Enqueued Resource ID: fd403c04-a16c-46b9-a6f8-e9ed371d0624 with Priority: HIGHEST for action port [ 592.615825] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_rules [ 592.616072] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 592.616251] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd403c04-a16c-46b9-a6f8-e9ed371d0624 with Priority: HIGHEST for action port [ 592.616461] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.617984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.617984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.617984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.617984] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.622282] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.622282] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.622282] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.622282] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd403c04-a16c-46b9-a6f8-e9ed371d0624 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd403c04-a16c-46b9-a6f8-e9ed371d0624" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd403c04-a16c-46b9-a6f8-e9ed371d0624" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.622282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd403c04-a16c-46b9-a6f8-e9ed371d0624" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.622282] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd403c04-a16c-46b9-a6f8-e9ed371d0624',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.842435] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 in Status: SUCCESS [ 592.842725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.884186] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.884415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.884488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.884944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.885069] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.885177] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 538155ed-ab13-4f7a-b3b5-bfff4be7b046 already deleted. [ 592.885261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-538155ed-ab13-4f7a-b3b5-bfff4be7b046" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.094661] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a in Status: SUCCESS [ 593.094661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.094661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.094661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.095401] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.095634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.095753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.096022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.096684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.096791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.097822] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.125326] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.125326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.126975] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.128091] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd403c04-a16c-46b9-a6f8-e9ed371d0624 with status ACTIVE [ 593.128091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.128320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.128320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.128417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.128467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.128654] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.132038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.132038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.132038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.132038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.132038] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.132038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.132038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.132038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.132038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.132038] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd403c04-a16c-46b9-a6f8-e9ed371d0624 is going to be updated. [ 593.151478] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.151680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.152070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.152070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.152070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.152200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd403c04-a16c-46b9-a6f8-e9ed371d0624" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.531342] env[63014]: INFO networking_nsxv3.common.synchronization [req-d0c92f2b-e514-46c5-908f-bb64b7880eba req-3077dfca-ec6a-4e22-b1b1-affed59dd79b tempest-ServersWithSpecificFlavorTestJSON-1510674973 tempest-ServersWithSpecificFlavorTestJSON-1510674973-project-member] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 593.531342] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 593.531342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.531342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.531342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.531648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.531803] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.531904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.531965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.532158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.532241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.532332] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.602245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ab69c49-5404-4dd4-a6d3-4fce8969088a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.602245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.602245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ab69c49-5404-4dd4-a6d3-4fce8969088a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.602245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.602245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.602887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.602887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.602887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.602887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.602887] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.633833] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.035865] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.035865] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.035865] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 already deleted. [ 594.035865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.094204] env[63014]: INFO networking_nsxv3.common.synchronization [req-21ed035a-21f4-447e-a8b8-55eecfa62c61 req-c94876fe-962c-44fa-859a-804ff1fbecef tempest-SecurityGroupRulesNegativeTestJSON-1783017906 tempest-SecurityGroupRulesNegativeTestJSON-1783017906-project-member] Enqueued Resource ID: b997ff7f-1d64-47d2-92f2-a51562a9cd0f with Priority: HIGHEST for action security_group_rules [ 594.094204] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b997ff7f-1d64-47d2-92f2-a51562a9cd0f with Priority: HIGHEST for action security_group_rules [ 594.094858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.095225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.095385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.095778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.095944] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b997ff7f-1d64-47d2-92f2-a51562a9cd0f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.106380] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ab69c49-5404-4dd4-a6d3-4fce8969088a: rpc.has_security_group_logging(os_id): False [ 594.129141] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.129141] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.129141] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.129141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.129778] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.129778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.129778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.129778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.129778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.129778] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a is going to be created. [ 594.136156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.136156] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.136156] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.136156] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.136156] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.136390] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be created. [ 594.166925] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.167231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.167420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.168375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.168375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.182225] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: UNINITIALIZED for 2s [ 594.193909] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: SUCCESS [ 594.193909] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 deletion is rescheduled due to dependency. [ 594.193909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.208211] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.208211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.208211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.208211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.208211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.227509] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a in Status: IN_PROGRESS for 2s [ 594.231840] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 594.232085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.291628] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.291934] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-111" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.292060] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-111" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.292399] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-111" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.292685] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.292850] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.292991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.293234] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.293423] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.293638] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 594.293750] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.293862] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.294060] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.294164] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 594.294260] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.294340] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.315336] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 in Status: SUCCESS [ 594.315454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.315652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.315891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.316099] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.316256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.316348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.316425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.316509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.316585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.316651] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.324286] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.327022] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 594.327022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.327022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-111" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.327022] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.327022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.327022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.327022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.327022] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('251d6227-8a75-4c9b-8cc6-a01cc6e7f402',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.366599] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67b29187-e991-47a0-93b3-5a8f6f288242 in Status: SUCCESS [ 594.366785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.617967] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.617967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.617967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.618260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.618260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.618260] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b997ff7f-1d64-47d2-92f2-a51562a9cd0f already deleted. [ 594.618400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b997ff7f-1d64-47d2-92f2-a51562a9cd0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.819922] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.832185] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.832701] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.834408] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.834408] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.834408] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.834408] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 251d6227-8a75-4c9b-8cc6-a01cc6e7f402 not found, creating... [ 594.834408] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.834408] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.834408] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.835593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.835593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.835593] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.835593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.835593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.835999] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.835999] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.835999] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 251d6227-8a75-4c9b-8cc6-a01cc6e7f402 is going to be created. [ 594.857066] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.857066] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.857066] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.857066] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.857066] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.857066] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.323450] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8: rpc.has_security_group_logging(os_id): False [ 595.341415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.341645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.341829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.342117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.342264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.342567] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.342702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.342735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.342917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.342993] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.343153] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 is going to be created. [ 595.401839] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.402101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.402101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.402429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.402571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.412971] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 in Status: IN_PROGRESS for 2s [ 595.442802] env[63014]: INFO networking_nsxv3.common.synchronization [req-d6c8bf34-f97a-47ce-95b4-f587a17fcef8 req-fc20c59a-d6ab-445e-8961-436076eda250 tempest-ServersV294TestFqdnHostnames-2073531531 tempest-ServersV294TestFqdnHostnames-2073531531-project-member] Enqueued Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_members [ 595.443615] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_members [ 595.444746] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.444923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.444989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.445303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.445516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.445623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.445685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.445913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.446038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.446139] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.840674] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-941 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.840887] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-941" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.841031] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-941" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.841461] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-941" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.841857] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.842427] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.842486] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.842704] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.842854] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.843141] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.843316] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.843455] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.843568] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.843680] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 595.843786] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.843926] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.863135] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.863444] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 595.863690] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.863912] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-941" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.864307] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-62e8e06d-55a7-47c7-a18e-24c1bd819556 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.864556] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-62e8e06d-55a7-47c7-a18e-24c1bd819556" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.864702] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-62e8e06d-55a7-47c7-a18e-24c1bd819556" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.865271] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-62e8e06d-55a7-47c7-a18e-24c1bd819556" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.865623] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e8e06d-55a7-47c7-a18e-24c1bd819556',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.948621] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.948621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.948621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.950666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.950666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.950666] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.950666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.950666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.950666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.950666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.950666] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d19bea52-b73c-4d06-87a2-c45103884998 already deleted. [ 595.950666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.190391] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 596.190698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.192039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.192318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.192571] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.192803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.192886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.193109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.193316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.193498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.193677] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.236044] env[63014]: INFO networking_nsxv3.common.synchronization [req-d0c92f2b-e514-46c5-908f-bb64b7880eba req-6e13a5d8-c475-4729-bdcd-fea2c7420af0 service nova] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_rules [ 596.236044] env[63014]: INFO networking_nsxv3.common.synchronization [req-d0c92f2b-e514-46c5-908f-bb64b7880eba req-6e13a5d8-c475-4729-bdcd-fea2c7420af0 service nova] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 596.236044] env[63014]: INFO networking_nsxv3.common.synchronization [req-d0c92f2b-e514-46c5-908f-bb64b7880eba req-6e13a5d8-c475-4729-bdcd-fea2c7420af0 service nova] Enqueued Resource ID: 251d6227-8a75-4c9b-8cc6-a01cc6e7f402 with Priority: HIGHEST for action port [ 596.236044] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_rules [ 596.236044] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 596.236044] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 251d6227-8a75-4c9b-8cc6-a01cc6e7f402 with Priority: HIGHEST for action port [ 596.236044] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.236044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.236044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.236044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.236044] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.237037] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.237161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.237228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.237397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.237542] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.237634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.237695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.237835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.237915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.238023] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.238744] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.238848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.238914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.241388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.241583] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('251d6227-8a75-4c9b-8cc6-a01cc6e7f402',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.245577] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a in Status: SUCCESS [ 596.246407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.367975] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.368385] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.368428] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.368738] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.370468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.370468] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 62e8e06d-55a7-47c7-a18e-24c1bd819556 not found, creating... [ 596.370468] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.370468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.370468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.370468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.370468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.371805] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.372240] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.375791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.375791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.375791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.375791] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 62e8e06d-55a7-47c7-a18e-24c1bd819556 is going to be created. [ 596.393415] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.393710] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.393710] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.394015] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.394251] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.394519] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-62e8e06d-55a7-47c7-a18e-24c1bd819556" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.696455] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.747502] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.752024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.752024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 251d6227-8a75-4c9b-8cc6-a01cc6e7f402 with status ACTIVE [ 596.752024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.752024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.752024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.752024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.753491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.753627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.753832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.753943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.754181] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 251d6227-8a75-4c9b-8cc6-a01cc6e7f402 is going to be updated. [ 596.777829] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.778187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.778187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.778710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.778710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.778710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-251d6227-8a75-4c9b-8cc6-a01cc6e7f402" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.201454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b44cf44-3516-4644-9659-498297843d9a: rpc.has_security_group_logging(os_id): False [ 597.225495] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.225768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.225768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.226085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.226184] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.226473] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.226587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.226664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.226835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.226905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.227048] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be created. [ 597.243668] env[63014]: INFO networking_nsxv3.common.synchronization [req-d28596dc-f328-4ba5-9a53-1d0bf42411c4 req-fc8b25f0-90d3-44f5-8495-ab00bc9102cb tempest-TenantUsagesTestJSON-670335680 tempest-TenantUsagesTestJSON-670335680-project-member] Enqueued Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGHEST for action security_group_members [ 597.244167] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGHEST for action security_group_members [ 597.244521] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-333e5887-ef6d-4e88-a132-91dc117462bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.244696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.244696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.244888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.245550] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.245759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.245882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.246111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.246248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.246382] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.252114] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.282241] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.282491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.282491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.282690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.282915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.295810] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 2s [ 597.368542] env[63014]: INFO networking_nsxv3.common.synchronization [req-d6c8bf34-f97a-47ce-95b4-f587a17fcef8 req-65992206-96c0-4989-8939-f82c1f109211 service nova] Enqueued Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_rules [ 597.368992] env[63014]: INFO networking_nsxv3.common.synchronization [req-d6c8bf34-f97a-47ce-95b4-f587a17fcef8 req-65992206-96c0-4989-8939-f82c1f109211 service nova] Enqueued Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_members [ 597.368992] env[63014]: INFO networking_nsxv3.common.synchronization [req-d6c8bf34-f97a-47ce-95b4-f587a17fcef8 req-65992206-96c0-4989-8939-f82c1f109211 service nova] Enqueued Resource ID: 62e8e06d-55a7-47c7-a18e-24c1bd819556 with Priority: HIGHEST for action port [ 597.369565] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_rules [ 597.369679] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_members [ 597.369763] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62e8e06d-55a7-47c7-a18e-24c1bd819556 with Priority: HIGHEST for action port [ 597.370475] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.370638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.370672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.370863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.370958] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.374348] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.374524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.374524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.374734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.375242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.375242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.375242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.375242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.375503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.375503] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.376256] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-62e8e06d-55a7-47c7-a18e-24c1bd819556 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.376371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62e8e06d-55a7-47c7-a18e-24c1bd819556" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.376848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62e8e06d-55a7-47c7-a18e-24c1bd819556" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.377064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62e8e06d-55a7-47c7-a18e-24c1bd819556" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.377602] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e8e06d-55a7-47c7-a18e-24c1bd819556',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.433355] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 in Status: SUCCESS [ 597.433355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.657819] env[63014]: INFO networking_nsxv3.common.synchronization [None req-995f96c3-8bfc-445e-a85e-6e269d08535d None None] Enqueued Resource ID: 957441a3-350d-4bf2-9b76-ee724cbad4ea with Priority: HIGHEST for action port [ 597.659894] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 957441a3-350d-4bf2-9b76-ee724cbad4ea with Priority: HIGHEST for action port [ 597.664790] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-957441a3-350d-4bf2-9b76-ee724cbad4ea taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.664790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-957441a3-350d-4bf2-9b76-ee724cbad4ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.664790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-957441a3-350d-4bf2-9b76-ee724cbad4ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.664790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-957441a3-350d-4bf2-9b76-ee724cbad4ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.664790] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('957441a3-350d-4bf2-9b76-ee724cbad4ea',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.748440] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.751892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.751892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.751892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.751892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.751892] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.751892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.751892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.751892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.751892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.751892] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e5887-ef6d-4e88-a132-91dc117462bb is going to be updated. [ 597.754918] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.755242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.755412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.755675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.755857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.756046] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be created. [ 597.777445] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.777445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.777445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.777445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.777445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.781017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.781017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.781017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.781017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.781017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.784576] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: UNINITIALIZED for 2s [ 597.786046] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 333e5887-ef6d-4e88-a132-91dc117462bb in Status: IN_PROGRESS for 2s [ 597.882171] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.882171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.882171] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.882171] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62e8e06d-55a7-47c7-a18e-24c1bd819556 with status ACTIVE [ 597.882171] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.882171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.882171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.882171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.882171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.882171] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.882171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.882171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.884101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.884567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.885541] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.885541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.885541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.885773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.885938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.886117] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62e8e06d-55a7-47c7-a18e-24c1bd819556 is going to be updated. [ 597.909922] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.909922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.909922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.909922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.909922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.909922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62e8e06d-55a7-47c7-a18e-24c1bd819556" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.166703] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 957441a3-350d-4bf2-9b76-ee724cbad4ea [ 598.166703] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.166703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.166703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.167676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.167676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.167676] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:957441a3-350d-4bf2-9b76-ee724cbad4ea already deleted. [ 598.167676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-957441a3-350d-4bf2-9b76-ee724cbad4ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.247559] env[63014]: INFO networking_nsxv3.common.synchronization [req-47387694-0bc7-4401-bcd5-bf932c5219c7 req-2d0c760b-723b-457f-b914-67c75f7e9e5a tempest-ImagesNegativeTestJSON-390298219 tempest-ImagesNegativeTestJSON-390298219-project-member] Enqueued Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGHEST for action security_group_members [ 598.247559] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGHEST for action security_group_members [ 598.247559] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c39243da-04ef-4faa-894b-970a67152377 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.247559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.247559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.247559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.248114] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.248234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.248325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.248513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.248611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.248693] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.389808] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.707253] env[63014]: INFO networking_nsxv3.common.synchronization [req-2c13340f-27bf-49d7-8bf7-8dc1dd0f79f0 req-652e2a0e-590a-48cc-a91d-3ea83e20d0c4 tempest-SecurityGroupRulesTestJSON-299309072 tempest-SecurityGroupRulesTestJSON-299309072-project-member] Enqueued Resource ID: 359ced3a-a45f-4f4a-bb1f-f95af1f6826b with Priority: HIGHEST for action security_group_rules [ 598.708088] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 359ced3a-a45f-4f4a-bb1f-f95af1f6826b with Priority: HIGHEST for action security_group_rules [ 598.708532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-359ced3a-a45f-4f4a-bb1f-f95af1f6826b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.708771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-359ced3a-a45f-4f4a-bb1f-f95af1f6826b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.708862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-359ced3a-a45f-4f4a-bb1f-f95af1f6826b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.709191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-359ced3a-a45f-4f4a-bb1f-f95af1f6826b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.709360] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('359ced3a-a45f-4f4a-bb1f-f95af1f6826b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.752532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.752715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.752787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.753092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.753256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.753459] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.753561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.753812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.753812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.754028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.754028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c39243da-04ef-4faa-894b-970a67152377 already deleted. [ 598.754028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.823536] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-429 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.823784] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-429" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.823905] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-429" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.824262] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-429" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.824610] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.824867] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.825109] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.825757] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.825757] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.826488] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.826488] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.826488] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.826642] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.826770] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 598.826953] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.827180] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.846216] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.846216] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 598.846216] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.846216] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-429" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.846439] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-41798dca-967d-4a7b-829d-fdcd3cc36a6f taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.846648] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-41798dca-967d-4a7b-829d-fdcd3cc36a6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.846872] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-41798dca-967d-4a7b-829d-fdcd3cc36a6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.847155] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-41798dca-967d-4a7b-829d-fdcd3cc36a6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.847327] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41798dca-967d-4a7b-829d-fdcd3cc36a6f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.893119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.893570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.893747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.894636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.894636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.894636] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d19bea52-b73c-4d06-87a2-c45103884998 is going to be created. [ 598.918057] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.918252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.918334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.918588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.918766] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.928377] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d19bea52-b73c-4d06-87a2-c45103884998 in Status: UNINITIALIZED for 2s [ 599.231253] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.231253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.231253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.231253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.231253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.231253] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 359ced3a-a45f-4f4a-bb1f-f95af1f6826b already deleted. [ 599.231253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-359ced3a-a45f-4f4a-bb1f-f95af1f6826b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.309088] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 599.309088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.351135] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.351415] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.351543] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.351891] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.352201] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.352309] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 41798dca-967d-4a7b-829d-fdcd3cc36a6f not found, creating... [ 599.352683] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.352871] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.352992] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.353256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.353429] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.353723] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.353888] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.354055] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.355874] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.356322] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.356447] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 41798dca-967d-4a7b-829d-fdcd3cc36a6f is going to be created. [ 599.381048] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.381048] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.381048] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.381048] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.381048] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.381417] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-41798dca-967d-4a7b-829d-fdcd3cc36a6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.715725] env[63014]: INFO networking_nsxv3.common.synchronization [None req-59aeb285-53e1-4921-82f3-275fa5492eac None None] Enqueued Resource ID: 81ee88ce-3339-441b-9d06-8289acd389dc with Priority: HIGHEST for action port [ 599.717969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81ee88ce-3339-441b-9d06-8289acd389dc with Priority: HIGHEST for action port [ 599.717969] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-81ee88ce-3339-441b-9d06-8289acd389dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.717969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81ee88ce-3339-441b-9d06-8289acd389dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.717969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81ee88ce-3339-441b-9d06-8289acd389dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.720827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81ee88ce-3339-441b-9d06-8289acd389dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.720827] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81ee88ce-3339-441b-9d06-8289acd389dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.794723] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: SUCCESS [ 599.795080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.795195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.795466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.796883] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.796883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.796883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.796883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.796883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.796883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.796883] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.798744] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 333e5887-ef6d-4e88-a132-91dc117462bb in Status: SUCCESS [ 599.798915] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 333e5887-ef6d-4e88-a132-91dc117462bb deletion is rescheduled due to dependency. [ 599.799021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.079080] env[63014]: INFO networking_nsxv3.common.synchronization [req-47387694-0bc7-4401-bcd5-bf932c5219c7 req-3686f36c-a0c1-4474-ba2f-ca6564cf7911 service nova] Enqueued Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGHEST for action security_group_rules [ 600.079251] env[63014]: INFO networking_nsxv3.common.synchronization [req-47387694-0bc7-4401-bcd5-bf932c5219c7 req-3686f36c-a0c1-4474-ba2f-ca6564cf7911 service nova] Enqueued Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGHEST for action security_group_members [ 600.079388] env[63014]: INFO networking_nsxv3.common.synchronization [req-47387694-0bc7-4401-bcd5-bf932c5219c7 req-3686f36c-a0c1-4474-ba2f-ca6564cf7911 service nova] Enqueued Resource ID: 41798dca-967d-4a7b-829d-fdcd3cc36a6f with Priority: HIGHEST for action port [ 600.079635] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGHEST for action security_group_rules [ 600.083291] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGHEST for action security_group_members [ 600.083291] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41798dca-967d-4a7b-829d-fdcd3cc36a6f with Priority: HIGHEST for action port [ 600.083291] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c39243da-04ef-4faa-894b-970a67152377 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.083291] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.083291] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c39243da-04ef-4faa-894b-970a67152377 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.083291] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.083291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.083291] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.084421] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-41798dca-967d-4a7b-829d-fdcd3cc36a6f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.084421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41798dca-967d-4a7b-829d-fdcd3cc36a6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.084421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41798dca-967d-4a7b-829d-fdcd3cc36a6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.087372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41798dca-967d-4a7b-829d-fdcd3cc36a6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.087372] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41798dca-967d-4a7b-829d-fdcd3cc36a6f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.222273] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81ee88ce-3339-441b-9d06-8289acd389dc [ 600.222817] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.222817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.222817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.222991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.222991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.223109] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81ee88ce-3339-441b-9d06-8289acd389dc already deleted. [ 600.223210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81ee88ce-3339-441b-9d06-8289acd389dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.300537] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.589292] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c39243da-04ef-4faa-894b-970a67152377 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.589292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.589292] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.593889] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41798dca-967d-4a7b-829d-fdcd3cc36a6f with status ACTIVE [ 600.593889] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.593889] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.593889] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.593889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.593889] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41798dca-967d-4a7b-829d-fdcd3cc36a6f is going to be updated. [ 600.618093] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.620280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.620280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.620280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.620280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.620280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41798dca-967d-4a7b-829d-fdcd3cc36a6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.803420] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 864e57d5-1404-49e7-b86e-6aa5865742d0: rpc.has_security_group_logging(os_id): False [ 600.820731] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.820927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.821655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.821655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.821655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.821655] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.821655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.821865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.821865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.821926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.822626] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be created. [ 600.877151] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.877151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.877151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.877369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.877369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.891470] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: IN_PROGRESS for 2s [ 600.940163] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d19bea52-b73c-4d06-87a2-c45103884998 in Status: SUCCESS [ 600.940397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.940660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.940914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.941164] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.941487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.941634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.941842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.941963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.942100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.942300] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.092797] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.208737] env[63014]: INFO networking_nsxv3.common.synchronization [None req-21a09bf9-5875-4054-b1ba-64b79b4418b8 tempest-ServersTestFqdnHostnames-1394113230 tempest-ServersTestFqdnHostnames-1394113230-project-member] Enqueued Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_rules [ 601.208737] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_rules [ 601.209443] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd91700-654d-4bc1-8b27-185db0eb3543 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.209685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.209840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.210179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.210358] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.396987] env[63014]: INFO networking_nsxv3.common.synchronization [None req-bdbe2ed9-4f11-4827-9c5d-15cd7470e96e tempest-ServersTestFqdnHostnames-1394113230 tempest-ServersTestFqdnHostnames-1394113230-project-member] Enqueued Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_rules [ 601.397715] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_rules [ 601.400749] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd91700-654d-4bc1-8b27-185db0eb3543 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.400749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.444817] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.596700] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.599170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.599170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.599170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.599170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.599170] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c39243da-04ef-4faa-894b-970a67152377 is going to be created. [ 601.622584] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.622584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.622584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.622584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.622584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.630344] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c39243da-04ef-4faa-894b-970a67152377 in Status: UNINITIALIZED for 2s [ 601.734635] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.734635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.734635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.734635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.734635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.734635] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd91700-654d-4bc1-8b27-185db0eb3543 already deleted. [ 601.734635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.734635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.734635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.734635] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.951382] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d19bea52-b73c-4d06-87a2-c45103884998: rpc.has_security_group_logging(os_id): False [ 601.972242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.972242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.972242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.972242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.972242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.974443] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.975707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.975707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.976381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.978601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.978601] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d19bea52-b73c-4d06-87a2-c45103884998 is going to be created. [ 602.032374] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.034111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.034111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.034111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.034111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.047143] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d19bea52-b73c-4d06-87a2-c45103884998 in Status: IN_PROGRESS for 2s [ 602.254838] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.254838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.254838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.254838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.254838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.254838] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd91700-654d-4bc1-8b27-185db0eb3543 already deleted. [ 602.254838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.908976] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: SUCCESS [ 602.912019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.641103] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c39243da-04ef-4faa-894b-970a67152377 in Status: SUCCESS [ 603.644177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.644177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.644177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.644177] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.644177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.644177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.644177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.644177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.644177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.644177] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.068320] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d19bea52-b73c-4d06-87a2-c45103884998 in Status: SUCCESS [ 604.068320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.153856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c39243da-04ef-4faa-894b-970a67152377 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.153856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.153856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c39243da-04ef-4faa-894b-970a67152377 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.153856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.158489] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.158489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.158489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.158489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.158489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.158489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.158489] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.661735] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c39243da-04ef-4faa-894b-970a67152377: rpc.has_security_group_logging(os_id): False [ 604.679257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.679257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.679257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.679257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.679257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.679257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.679257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.679257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.679845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.679845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.680774] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.680886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.680943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.681115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.681193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.681391] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.681491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.681550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.681694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.681768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.681853] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c39243da-04ef-4faa-894b-970a67152377 is going to be created. [ 604.727027] env[63014]: INFO networking_nsxv3.common.synchronization [req-cf5d572b-7501-4ad6-b821-d043b2344ca3 req-5deed890-fc82-4291-9fa6-ae4a910fa802 tempest-SecurityGroupRulesTestJSON-299309072 tempest-SecurityGroupRulesTestJSON-299309072-project-member] Enqueued Resource ID: 3141850f-d840-40dc-b822-3a97450e5bf2 with Priority: HIGHEST for action security_group_rules [ 604.727027] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3141850f-d840-40dc-b822-3a97450e5bf2 with Priority: HIGHEST for action security_group_rules [ 604.727027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3141850f-d840-40dc-b822-3a97450e5bf2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.727027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3141850f-d840-40dc-b822-3a97450e5bf2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.727610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3141850f-d840-40dc-b822-3a97450e5bf2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.727891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3141850f-d840-40dc-b822-3a97450e5bf2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.727988] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3141850f-d840-40dc-b822-3a97450e5bf2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.735566] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.735566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.735687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.735784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.736901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.748590] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c39243da-04ef-4faa-894b-970a67152377 in Status: IN_PROGRESS for 2s [ 605.252516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.252850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.252850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.253118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.253269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.253308] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3141850f-d840-40dc-b822-3a97450e5bf2 already deleted. [ 605.253520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3141850f-d840-40dc-b822-3a97450e5bf2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.763417] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c39243da-04ef-4faa-894b-970a67152377 in Status: SUCCESS [ 606.763417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.182672] env[63014]: INFO networking_nsxv3.common.synchronization [req-c8d1b912-dde4-4ac4-8880-349709d41fe2 req-865fb7ab-9230-4e15-abd0-0978bf252fdd tempest-ServerDiagnosticsTest-1628797124 tempest-ServerDiagnosticsTest-1628797124-project-member] Enqueued Resource ID: 67b29187-e991-47a0-93b3-5a8f6f288242 with Priority: HIGHEST for action security_group_members [ 607.183495] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b29187-e991-47a0-93b3-5a8f6f288242 with Priority: HIGHEST for action security_group_members [ 607.183814] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-67b29187-e991-47a0-93b3-5a8f6f288242 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.183814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.183814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.187784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.187784] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.187784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.187784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.188116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.188477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.188477] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67b29187-e991-47a0-93b3-5a8f6f288242',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.328019] env[63014]: INFO networking_nsxv3.common.synchronization [req-8cb8d172-447c-4792-a61d-767b669af476 req-7db1f998-dd53-4604-b0e3-872000756784 tempest-FloatingIPsAssociationTestJSON-1182186772 tempest-FloatingIPsAssociationTestJSON-1182186772-project-member] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 607.328695] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 607.330330] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.330530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.332048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.332048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.332048] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.332048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.332048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.332048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.332048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.332048] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.690850] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.691033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.691211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.691398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.691506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.691611] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.691708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.691760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.691912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.691982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.692086] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67b29187-e991-47a0-93b3-5a8f6f288242 is going to be updated. [ 607.736498] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.736498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.736498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.736784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.736821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.752660] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67b29187-e991-47a0-93b3-5a8f6f288242 in Status: IN_PROGRESS for 2s [ 607.834964] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.339098] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.344976] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-931 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.345129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-931" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.345279] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-931" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.345555] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-931" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.345842] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.347161] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.347402] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.347663] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.347925] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.348123] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 608.348298] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.348442] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.348568] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.348737] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 608.348863] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.350727] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.373039] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.373039] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 608.373039] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.373039] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-931" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.373039] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-d02c6387-f8d9-4a2a-a22e-9250aee2b499 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.373039] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-d02c6387-f8d9-4a2a-a22e-9250aee2b499" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.373039] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-d02c6387-f8d9-4a2a-a22e-9250aee2b499" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.373575] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-d02c6387-f8d9-4a2a-a22e-9250aee2b499" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.373575] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d02c6387-f8d9-4a2a-a22e-9250aee2b499',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.533078] env[63014]: INFO networking_nsxv3.common.synchronization [req-f3059530-9e19-41ed-ba17-1455a7b54cfe req-d31b022b-2a84-4056-88e5-93f90ac1282f tempest-ServerDiagnosticsNegativeTest-1963020951 tempest-ServerDiagnosticsNegativeTest-1963020951-project-member] Enqueued Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGHEST for action security_group_members [ 608.533078] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGHEST for action security_group_members [ 608.533078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ab69c49-5404-4dd4-a6d3-4fce8969088a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.533078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.533078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.533078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.533078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.533078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.533078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.533078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.533078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.533078] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.843496] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.843816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.843816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.843976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.843976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.844139] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 is going to be updated. [ 608.880553] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.880553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.880553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.880553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.880553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.880553] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port d02c6387-f8d9-4a2a-a22e-9250aee2b499 not found, creating... [ 608.880553] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.880553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.880553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.880553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.880553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.881450] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.881450] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.881450] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.881580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.882751] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.882751] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: d02c6387-f8d9-4a2a-a22e-9250aee2b499 is going to be created. [ 608.884214] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.884372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.884441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.884810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.884955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.895405] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: IN_PROGRESS for 2s [ 608.909344] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.909344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.909344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.909344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.909344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.909344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-d02c6387-f8d9-4a2a-a22e-9250aee2b499" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.036464] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.036660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.036735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.037452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.037452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.037452] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.037452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.037452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.037691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.037691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.037779] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a is going to be updated. [ 609.073658] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.074272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.074479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.075140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.075534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.088405] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a in Status: IN_PROGRESS for 2s [ 609.665436] env[63014]: INFO networking_nsxv3.common.synchronization [req-fc07ae27-1945-4587-970f-275ecdf08b61 req-077d304a-849a-446a-b3f1-2022756a2f2e tempest-SecurityGroupRulesTestJSON-299309072 tempest-SecurityGroupRulesTestJSON-299309072-project-member] Enqueued Resource ID: a3173b97-1ed9-4342-b36d-845ebabcd4ea with Priority: HIGHEST for action security_group_rules [ 609.665849] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3173b97-1ed9-4342-b36d-845ebabcd4ea with Priority: HIGHEST for action security_group_rules [ 609.666374] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3173b97-1ed9-4342-b36d-845ebabcd4ea taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.667038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3173b97-1ed9-4342-b36d-845ebabcd4ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.667038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3173b97-1ed9-4342-b36d-845ebabcd4ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.667283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3173b97-1ed9-4342-b36d-845ebabcd4ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.667410] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3173b97-1ed9-4342-b36d-845ebabcd4ea',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.765188] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67b29187-e991-47a0-93b3-5a8f6f288242 in Status: SUCCESS [ 609.765379] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67b29187-e991-47a0-93b3-5a8f6f288242 deletion is rescheduled due to dependency. [ 609.765477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67b29187-e991-47a0-93b3-5a8f6f288242" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.025263] env[63014]: INFO networking_nsxv3.common.synchronization [req-8cb8d172-447c-4792-a61d-767b669af476 req-b04dbec3-bf1c-4e60-b7aa-772f88f42311 service nova] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_rules [ 610.025546] env[63014]: INFO networking_nsxv3.common.synchronization [req-8cb8d172-447c-4792-a61d-767b669af476 req-b04dbec3-bf1c-4e60-b7aa-772f88f42311 service nova] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 610.025596] env[63014]: INFO networking_nsxv3.common.synchronization [req-8cb8d172-447c-4792-a61d-767b669af476 req-b04dbec3-bf1c-4e60-b7aa-772f88f42311 service nova] Enqueued Resource ID: d02c6387-f8d9-4a2a-a22e-9250aee2b499 with Priority: HIGHEST for action port [ 610.025843] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_rules [ 610.026035] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 610.026173] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d02c6387-f8d9-4a2a-a22e-9250aee2b499 with Priority: HIGHEST for action port [ 610.026745] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.026875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.026942] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.027887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.028039] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.032287] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.032287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.032287] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-d02c6387-f8d9-4a2a-a22e-9250aee2b499 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.032287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d02c6387-f8d9-4a2a-a22e-9250aee2b499" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.032287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d02c6387-f8d9-4a2a-a22e-9250aee2b499" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.032287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d02c6387-f8d9-4a2a-a22e-9250aee2b499" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.032287] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d02c6387-f8d9-4a2a-a22e-9250aee2b499',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.190985] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.190985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.191708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.191708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.191708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.191708] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3173b97-1ed9-4342-b36d-845ebabcd4ea already deleted. [ 610.191708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3173b97-1ed9-4342-b36d-845ebabcd4ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.309565] env[63014]: INFO networking_nsxv3.common.synchronization [req-ec33f49f-fae3-4b2d-bdf6-994354506286 req-e78d5cbe-6e46-4440-bfc1-a97b03e79a91 tempest-ServersTestBootFromVolume-1738521807 tempest-ServersTestBootFromVolume-1738521807-project-member] Enqueued Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_members [ 610.310135] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_members [ 610.310608] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2e75af-7b53-4662-af96-bb7c5bccaeba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.310608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.310608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.310867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.311405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.311585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.311670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.312068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.312245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.312392] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.533067] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.533067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.535280] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d02c6387-f8d9-4a2a-a22e-9250aee2b499 with status ACTIVE [ 610.535488] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.535617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.535700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.535924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.536019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.536203] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.536320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.536357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.536511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.536590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.540027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.540027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.540027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.540027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.540027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.540027] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d02c6387-f8d9-4a2a-a22e-9250aee2b499 is going to be updated. [ 610.565222] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.565222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.565222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.565222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.565222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.565222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d02c6387-f8d9-4a2a-a22e-9250aee2b499" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.816531] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.819354] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.819354] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba already deleted. [ 610.819354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.907749] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: SUCCESS [ 610.907968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.908159] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.908452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.909994] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.909994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.909994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.909994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.909994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.909994] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.107944] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a in Status: SUCCESS [ 611.107944] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a deletion is rescheduled due to dependency. [ 611.107944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.415028] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.768701] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-610 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.768975] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-610" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.769829] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-610" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.769976] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-610" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.770371] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.770607] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.770791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.771132] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.771353] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.771635] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.771818] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.771984] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.772163] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.772433] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 611.774040] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.775849] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.782365] env[63014]: INFO networking_nsxv3.common.synchronization [None req-c73e9656-2aed-459b-bba8-5d167e9eae66 None None] Enqueued Resource ID: 0f9c27e8-fab3-4afa-a57a-d05e101cf2da with Priority: HIGHEST for action port [ 611.783048] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9c27e8-fab3-4afa-a57a-d05e101cf2da with Priority: HIGHEST for action port [ 611.783658] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f9c27e8-fab3-4afa-a57a-d05e101cf2da taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.783658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f9c27e8-fab3-4afa-a57a-d05e101cf2da" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.783823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f9c27e8-fab3-4afa-a57a-d05e101cf2da" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.784073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f9c27e8-fab3-4afa-a57a-d05e101cf2da" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.784151] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9c27e8-fab3-4afa-a57a-d05e101cf2da',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.793204] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.793204] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 611.793500] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.794117] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-610" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.794694] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-a95803c7-4b35-4519-afc8-18e81d24b5cc taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.795231] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-a95803c7-4b35-4519-afc8-18e81d24b5cc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.795231] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-a95803c7-4b35-4519-afc8-18e81d24b5cc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.799437] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-a95803c7-4b35-4519-afc8-18e81d24b5cc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.799437] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a95803c7-4b35-4519-afc8-18e81d24b5cc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.920276] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.274622] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d67d4c11-b8ac-4c44-a225-1f09830a1043 None None] Enqueued Resource ID: 9de6abdc-6f48-4750-a459-65e25c1f1a18 with Priority: HIGHEST for action port [ 612.274622] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de6abdc-6f48-4750-a459-65e25c1f1a18 with Priority: HIGHEST for action port [ 612.274622] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-9de6abdc-6f48-4750-a459-65e25c1f1a18 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.274622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9de6abdc-6f48-4750-a459-65e25c1f1a18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.274622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9de6abdc-6f48-4750-a459-65e25c1f1a18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.274622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9de6abdc-6f48-4750-a459-65e25c1f1a18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.274622] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9de6abdc-6f48-4750-a459-65e25c1f1a18',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.287134] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f9c27e8-fab3-4afa-a57a-d05e101cf2da [ 612.287134] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.287134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.287134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.287134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.287134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.287475] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f9c27e8-fab3-4afa-a57a-d05e101cf2da already deleted. [ 612.287539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f9c27e8-fab3-4afa-a57a-d05e101cf2da" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.302428] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.302573] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.302573] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.302869] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.303037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.303195] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port a95803c7-4b35-4519-afc8-18e81d24b5cc not found, creating... [ 612.303495] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.303647] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.303774] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.303999] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.304160] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.304903] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.305663] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.305836] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.306095] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.306244] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.306391] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: a95803c7-4b35-4519-afc8-18e81d24b5cc is going to be created. [ 612.328666] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.329155] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.329155] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.329303] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.329566] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.329798] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-a95803c7-4b35-4519-afc8-18e81d24b5cc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.394805] env[63014]: INFO networking_nsxv3.common.synchronization [req-13574483-6e8b-40e5-90c8-ea273d463ca7 req-0262268a-b297-4e06-a2a2-26d9901a2f3a tempest-InstanceActionsNegativeTestJSON-1007421309 tempest-InstanceActionsNegativeTestJSON-1007421309-project-member] Enqueued Resource ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 with Priority: HIGHEST for action security_group_members [ 612.395375] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 with Priority: HIGHEST for action security_group_members [ 612.395731] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d88dc5-1e20-4ce5-b224-a55bea6c2304 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.395858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.395898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.396178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.396351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.396474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.396519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.396669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.396748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.396854] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22d88dc5-1e20-4ce5-b224-a55bea6c2304',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.426473] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.426473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.426473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.426473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.426473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.426473] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 is going to be updated. [ 612.470577] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.470577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.470577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.470577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.470577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.487886] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: IN_PROGRESS for 2s [ 612.777735] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9de6abdc-6f48-4750-a459-65e25c1f1a18 [ 612.777982] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.778133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.778227] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.778534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.778647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.778752] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9de6abdc-6f48-4750-a459-65e25c1f1a18 already deleted. [ 612.778838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9de6abdc-6f48-4750-a459-65e25c1f1a18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.900844] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.901702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.901780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.902036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.902133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.902346] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.902456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.902516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.902679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.902753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.902837] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 already deleted. [ 612.902917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.193988] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.196181] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-40" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.196181] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-40" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.196181] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-40" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.196748] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.197198] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.200086] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.200086] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.200086] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.200086] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 613.200086] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.200086] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.200086] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.200086] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 613.200086] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.200086] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.219211] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.219388] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 613.219532] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.219736] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-40" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.220058] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-8fe95cbe-9472-4c8f-96be-69e76672199c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.220247] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-8fe95cbe-9472-4c8f-96be-69e76672199c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.220371] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-8fe95cbe-9472-4c8f-96be-69e76672199c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.221224] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-8fe95cbe-9472-4c8f-96be-69e76672199c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.221224] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe95cbe-9472-4c8f-96be-69e76672199c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.726851] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.726851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.726851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.726851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.726851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.726851] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 8fe95cbe-9472-4c8f-96be-69e76672199c not found, creating... [ 613.726851] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.727436] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.727436] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.727436] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.727644] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.728367] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.728367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.728367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.728367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.728735] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.728735] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 8fe95cbe-9472-4c8f-96be-69e76672199c is going to be created. [ 613.747339] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.747560] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.747687] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.747963] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.748406] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.748641] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-8fe95cbe-9472-4c8f-96be-69e76672199c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.995817] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ca81518f-2884-4079-8b08-2bd9f890f547 None None] Enqueued Resource ID: 88e30fce-038c-47eb-8ddf-ee411e92d005 with Priority: HIGHEST for action port [ 613.995870] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88e30fce-038c-47eb-8ddf-ee411e92d005 with Priority: HIGHEST for action port [ 613.996825] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-88e30fce-038c-47eb-8ddf-ee411e92d005 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.996825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88e30fce-038c-47eb-8ddf-ee411e92d005" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.996825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88e30fce-038c-47eb-8ddf-ee411e92d005" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.997034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88e30fce-038c-47eb-8ddf-ee411e92d005" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.997034] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88e30fce-038c-47eb-8ddf-ee411e92d005',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.185207] env[63014]: INFO networking_nsxv3.common.synchronization [req-ec33f49f-fae3-4b2d-bdf6-994354506286 req-15b6e928-c33e-4380-b5c8-fb7052c3c277 service nova] Enqueued Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_rules [ 614.185396] env[63014]: INFO networking_nsxv3.common.synchronization [req-ec33f49f-fae3-4b2d-bdf6-994354506286 req-15b6e928-c33e-4380-b5c8-fb7052c3c277 service nova] Enqueued Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_members [ 614.185654] env[63014]: INFO networking_nsxv3.common.synchronization [req-ec33f49f-fae3-4b2d-bdf6-994354506286 req-15b6e928-c33e-4380-b5c8-fb7052c3c277 service nova] Enqueued Resource ID: a95803c7-4b35-4519-afc8-18e81d24b5cc with Priority: HIGHEST for action port [ 614.185790] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_rules [ 614.185984] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_members [ 614.186806] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a95803c7-4b35-4519-afc8-18e81d24b5cc with Priority: HIGHEST for action port [ 614.187972] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.187972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.187972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.187972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.188365] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.190078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2e75af-7b53-4662-af96-bb7c5bccaeba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.190547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.190700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.190994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.191265] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.191454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.191704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.191892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.192021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.192416] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.193534] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-a95803c7-4b35-4519-afc8-18e81d24b5cc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.193735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a95803c7-4b35-4519-afc8-18e81d24b5cc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.193897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a95803c7-4b35-4519-afc8-18e81d24b5cc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.195396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a95803c7-4b35-4519-afc8-18e81d24b5cc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.195396] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a95803c7-4b35-4519-afc8-18e81d24b5cc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.498581] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: SUCCESS [ 614.499153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.499153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.499375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.499766] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.499766] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.500698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.500935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.501165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.501838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.501979] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.503195] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88e30fce-038c-47eb-8ddf-ee411e92d005 [ 614.503195] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.504215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.504431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.504524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.504611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.504703] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88e30fce-038c-47eb-8ddf-ee411e92d005 already deleted. [ 614.504928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88e30fce-038c-47eb-8ddf-ee411e92d005" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.696301] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.697560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2e75af-7b53-4662-af96-bb7c5bccaeba taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.697560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.697974] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a95803c7-4b35-4519-afc8-18e81d24b5cc with status ACTIVE [ 614.698108] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.698210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.698267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.698518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.699046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.699046] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.699046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.699046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.702484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.702484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.702484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.702484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.702484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.702484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.702484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.702484] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a95803c7-4b35-4519-afc8-18e81d24b5cc is going to be updated. [ 614.722698] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.722698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.722698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.722698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.723027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.723114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a95803c7-4b35-4519-afc8-18e81d24b5cc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.009733] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.009733] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.009733] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.009733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.010556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.010556] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.010556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.010556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.010556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.010556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.010556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.010556] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.199296] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.263660] env[63014]: INFO networking_nsxv3.common.synchronization [None req-35b2ea4c-b16e-4869-98ed-6285c4fb60ae None None] Enqueued Resource ID: 736649b9-6d21-4878-b554-a37c691d9f8c with Priority: HIGHEST for action port [ 615.264320] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 736649b9-6d21-4878-b554-a37c691d9f8c with Priority: HIGHEST for action port [ 615.264511] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-736649b9-6d21-4878-b554-a37c691d9f8c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.264655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-736649b9-6d21-4878-b554-a37c691d9f8c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.264921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-736649b9-6d21-4878-b554-a37c691d9f8c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.264979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-736649b9-6d21-4878-b554-a37c691d9f8c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.265055] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('736649b9-6d21-4878-b554-a37c691d9f8c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.514641] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7989ce3f-24d4-41ad-b400-9895be68ebe4: rpc.has_security_group_logging(os_id): False [ 615.517292] env[63014]: INFO networking_nsxv3.common.synchronization [req-13574483-6e8b-40e5-90c8-ea273d463ca7 req-eebe1075-299d-4cec-bb10-e7808cc4e8fd service nova] Enqueued Resource ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 with Priority: HIGHEST for action security_group_rules [ 615.517559] env[63014]: INFO networking_nsxv3.common.synchronization [req-13574483-6e8b-40e5-90c8-ea273d463ca7 req-eebe1075-299d-4cec-bb10-e7808cc4e8fd service nova] Enqueued Resource ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 with Priority: HIGHEST for action security_group_members [ 615.517814] env[63014]: INFO networking_nsxv3.common.synchronization [req-13574483-6e8b-40e5-90c8-ea273d463ca7 req-eebe1075-299d-4cec-bb10-e7808cc4e8fd service nova] Enqueued Resource ID: 8fe95cbe-9472-4c8f-96be-69e76672199c with Priority: HIGHEST for action port [ 615.518501] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 with Priority: HIGHEST for action security_group_rules [ 615.518860] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 with Priority: HIGHEST for action security_group_members [ 615.518996] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fe95cbe-9472-4c8f-96be-69e76672199c with Priority: HIGHEST for action port [ 615.519711] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22d88dc5-1e20-4ce5-b224-a55bea6c2304 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.519876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.520000] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.520288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.520474] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22d88dc5-1e20-4ce5-b224-a55bea6c2304',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.521396] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d88dc5-1e20-4ce5-b224-a55bea6c2304 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.521972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.521972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.521972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.522491] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.522491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.522491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.522798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.522966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.523105] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22d88dc5-1e20-4ce5-b224-a55bea6c2304',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.523958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fe95cbe-9472-4c8f-96be-69e76672199c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.525146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fe95cbe-9472-4c8f-96be-69e76672199c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.525146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fe95cbe-9472-4c8f-96be-69e76672199c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.525146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fe95cbe-9472-4c8f-96be-69e76672199c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.525146] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe95cbe-9472-4c8f-96be-69e76672199c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.537900] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.537900] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.537900] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.537900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.538450] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.538450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.539976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.539976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.539976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.545022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 is going to be updated. [ 615.600972] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.602664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.602664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.602664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.602664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.618482] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: IN_PROGRESS for 2s [ 615.702031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.702231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.702231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.702363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.702577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.702577] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba is going to be created. [ 615.728838] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.729030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.729089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.729265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.729426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.739043] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba in Status: UNINITIALIZED for 2s [ 615.769980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 736649b9-6d21-4878-b554-a37c691d9f8c [ 615.769980] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.769980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.769980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.769980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.769980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.769980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:736649b9-6d21-4878-b554-a37c691d9f8c already deleted. [ 615.769980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-736649b9-6d21-4878-b554-a37c691d9f8c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.029074] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('22d88dc5-1e20-4ce5-b224-a55bea6c2304',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.029074] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d88dc5-1e20-4ce5-b224-a55bea6c2304 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.029433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.029433] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fe95cbe-9472-4c8f-96be-69e76672199c with status ACTIVE [ 616.029504] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.029588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.029627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.029836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.029920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.030684] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.031714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.031714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.031714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.031714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.031905] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.031905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.032021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.032118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.032202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.032290] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fe95cbe-9472-4c8f-96be-69e76672199c is going to be updated. [ 616.052575] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.052737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.053423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.053536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.053678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.053866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fe95cbe-9472-4c8f-96be-69e76672199c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.310642] env[63014]: INFO networking_nsxv3.common.synchronization [None req-59298e70-ae07-4ecc-80fc-cd016abcba23 None None] Enqueued Resource ID: 00ba0a1d-c520-4613-8e10-0c96ce29312f with Priority: HIGHEST for action port [ 616.310894] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00ba0a1d-c520-4613-8e10-0c96ce29312f with Priority: HIGHEST for action port [ 616.311573] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-00ba0a1d-c520-4613-8e10-0c96ce29312f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.311705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00ba0a1d-c520-4613-8e10-0c96ce29312f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.311770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00ba0a1d-c520-4613-8e10-0c96ce29312f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.313062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00ba0a1d-c520-4613-8e10-0c96ce29312f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.313189] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00ba0a1d-c520-4613-8e10-0c96ce29312f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.329095] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ea730d83-0c85-4398-ad84-cf6a6891d735 None None] Enqueued Resource ID: 583ad4de-aa9e-48fa-9a9e-c86472bfdc32 with Priority: HIGHEST for action port [ 616.329731] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 583ad4de-aa9e-48fa-9a9e-c86472bfdc32 with Priority: HIGHEST for action port [ 616.331072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-583ad4de-aa9e-48fa-9a9e-c86472bfdc32 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.331072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-583ad4de-aa9e-48fa-9a9e-c86472bfdc32" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.331072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-583ad4de-aa9e-48fa-9a9e-c86472bfdc32" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.331072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-583ad4de-aa9e-48fa-9a9e-c86472bfdc32" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.331072] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('583ad4de-aa9e-48fa-9a9e-c86472bfdc32',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.336196] env[63014]: INFO networking_nsxv3.common.synchronization [req-d8b31092-72c6-4dea-b26c-ff2bc1492a50 req-26a508e6-6be8-4fca-bdf5-470ea0c68697 tempest-ImagesNegativeTestJSON-390298219 tempest-ImagesNegativeTestJSON-390298219-project-member] Enqueued Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGHEST for action security_group_members [ 616.336702] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGHEST for action security_group_members [ 616.340278] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c39243da-04ef-4faa-894b-970a67152377 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.340278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.340278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.340278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.340278] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.340278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.340278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.340278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.340278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.340278] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.534549] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('22d88dc5-1e20-4ce5-b224-a55bea6c2304',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.816649] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00ba0a1d-c520-4613-8e10-0c96ce29312f [ 616.816861] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.817082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.817668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.817668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.817668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.817668] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00ba0a1d-c520-4613-8e10-0c96ce29312f already deleted. [ 616.817993] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00ba0a1d-c520-4613-8e10-0c96ce29312f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.833294] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 583ad4de-aa9e-48fa-9a9e-c86472bfdc32 [ 616.833883] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.834517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.834733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.835056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.835856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.835856] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:583ad4de-aa9e-48fa-9a9e-c86472bfdc32 already deleted. [ 616.835856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-583ad4de-aa9e-48fa-9a9e-c86472bfdc32" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.841137] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.841289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.841289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.841482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.841674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.841781] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.841974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.841974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.842096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.842148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.842235] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c39243da-04ef-4faa-894b-970a67152377 is going to be updated. [ 616.885950] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.886120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.888016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.888016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.888016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.899189] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c39243da-04ef-4faa-894b-970a67152377 in Status: IN_PROGRESS for 2s [ 617.038381] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.038381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.038381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.040510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.040510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.040510] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 is going to be created. [ 617.064162] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.064263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.064578] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.064578] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.064784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.074443] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 in Status: UNINITIALIZED for 2s [ 617.651286] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: SUCCESS [ 617.651533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.752569] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba in Status: SUCCESS [ 617.752982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.753160] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.753272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.753505] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.753670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.755336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.755336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.755336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.755336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.755336] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.756755] env[63014]: INFO networking_nsxv3.common.synchronization [req-fabcbafc-60d7-4c6c-970c-29792fca8885 req-1d06f416-1064-4b64-b76e-b9c3c33a9f60 tempest-SecurityGroupRulesTestJSON-299309072 tempest-SecurityGroupRulesTestJSON-299309072-project-member] Enqueued Resource ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d with Priority: HIGHEST for action security_group_rules [ 617.757597] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d with Priority: HIGHEST for action security_group_rules [ 617.757816] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.757989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.758104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.758390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.758468] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c9cf2e-ee4d-4313-a20d-153b95684b1d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.257890] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.282648] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.282848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.282976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.283466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.283466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.284452] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d already deleted. [ 618.284452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.761769] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c2e75af-7b53-4662-af96-bb7c5bccaeba: rpc.has_security_group_logging(os_id): False [ 618.780394] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.780553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.780625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.780848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.780945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.781197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.781303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.781368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.781530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.781611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.781697] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba is going to be created. [ 618.806543] env[63014]: INFO networking_nsxv3.common.synchronization [None req-301afb19-950c-4a80-bf1a-819ef61569aa None None] Enqueued Resource ID: f1ae6c03-893b-4b45-9365-fbef132198b0 with Priority: HIGHEST for action port [ 618.813536] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ae6c03-893b-4b45-9365-fbef132198b0 with Priority: HIGHEST for action port [ 618.813536] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1ae6c03-893b-4b45-9365-fbef132198b0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.813536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1ae6c03-893b-4b45-9365-fbef132198b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.813536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1ae6c03-893b-4b45-9365-fbef132198b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.813536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1ae6c03-893b-4b45-9365-fbef132198b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.813536] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ae6c03-893b-4b45-9365-fbef132198b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.838234] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.839049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.841026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.841026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.841026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.854855] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba in Status: IN_PROGRESS for 2s [ 618.907584] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c39243da-04ef-4faa-894b-970a67152377 in Status: SUCCESS [ 618.907771] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c39243da-04ef-4faa-894b-970a67152377 deletion is rescheduled due to dependency. [ 618.907884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.084354] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 in Status: SUCCESS [ 619.084537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.084705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.084920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.085120] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.085242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.085308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.085466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.085573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.085667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.085805] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('22d88dc5-1e20-4ce5-b224-a55bea6c2304',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.315534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1ae6c03-893b-4b45-9365-fbef132198b0 [ 619.315796] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.315944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.316025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.316258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.316368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.317090] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1ae6c03-893b-4b45-9365-fbef132198b0 already deleted. [ 619.317090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1ae6c03-893b-4b45-9365-fbef132198b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.471089] env[63014]: INFO networking_nsxv3.common.synchronization [req-c7ee1b66-cbd8-43ca-a251-288085efcef3 req-57320546-8c19-4373-9e26-3c734d0415c0 tempest-SecurityGroupRulesTestJSON-299309072 tempest-SecurityGroupRulesTestJSON-299309072-project-member] Enqueued Resource ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d with Priority: HIGHEST for action security_group_rules [ 619.471610] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d with Priority: HIGHEST for action security_group_rules [ 619.471916] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.472160] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.472263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.472468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.472548] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c9cf2e-ee4d-4313-a20d-153b95684b1d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.523713] env[63014]: INFO networking_nsxv3.common.synchronization [req-edb49c75-6c80-42c0-ba33-bbc51975ac06 req-a7b941c3-763f-487d-ae53-a49ea6874a83 tempest-MigrationsAdminTest-518512597 tempest-MigrationsAdminTest-518512597-project-member] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 619.523713] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 619.524149] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.524149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.524353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.524506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.524655] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.524761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.524817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.524980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.525254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.525358] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.588440] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d88dc5-1e20-4ce5-b224-a55bea6c2304 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.588606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.588690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.588880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.589072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.589209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.589312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.589392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.589454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.590223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.591633] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d88dc5-1e20-4ce5-b224-a55bea6c2304 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.591633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.591633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.591633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.591633] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.591633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.591633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.591633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.591633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.591633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.592144] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('22d88dc5-1e20-4ce5-b224-a55bea6c2304',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.996175] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.996334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.996405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.996626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.996718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.996815] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d already deleted. [ 619.996898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.027500] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.027680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.027744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.027965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.028068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.028267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.028369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.028435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.028589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.028664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.028750] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 already deleted. [ 620.028833] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.094331] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 22d88dc5-1e20-4ce5-b224-a55bea6c2304: rpc.has_security_group_logging(os_id): False [ 620.114922] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.115077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.115155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.115370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.115466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.115673] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.115795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.115863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.116039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.116125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.116314] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.116409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.116732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.116732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.116732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.116851] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.116943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.117097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.117150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.117222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.117307] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 is going to be created. [ 620.180029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.180029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.180029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.180293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.180437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.193619] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 in Status: IN_PROGRESS for 2s [ 620.198507] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.198798] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.198848] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.199260] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.199431] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.201037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.201878] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.202183] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.202565] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.202876] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.202926] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.203092] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.203186] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.203304] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 620.203470] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.203782] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.207263] env[63014]: INFO networking_nsxv3.common.synchronization [None req-92c6e403-c615-4cc2-9f94-999df8f2e43b tempest-AttachVolumeShelveTestJSON-960433482 tempest-AttachVolumeShelveTestJSON-960433482-project-member] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_rules [ 620.208431] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_rules [ 620.209280] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.209681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.209832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.210288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.210288] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.223611] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.223862] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 620.224651] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.224886] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.225538] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-11ec4696-291e-43e6-8fae-c07a38137745 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.225538] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-11ec4696-291e-43e6-8fae-c07a38137745" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.225725] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-11ec4696-291e-43e6-8fae-c07a38137745" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.226210] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-11ec4696-291e-43e6-8fae-c07a38137745" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.227257] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11ec4696-291e-43e6-8fae-c07a38137745',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.353128] env[63014]: INFO networking_nsxv3.common.synchronization [None req-005c836a-0531-40bb-a737-3aab2a180310 tempest-AttachVolumeShelveTestJSON-960433482 tempest-AttachVolumeShelveTestJSON-960433482-project-member] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_rules [ 620.354085] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_rules [ 620.354718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.354879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.606240] env[63014]: INFO networking_nsxv3.common.synchronization [None req-9ce0d85e-cdb4-4634-99de-84927782cd80 None None] Enqueued Resource ID: 5d0e120e-fe1d-452e-84f0-0230ee3bbe00 with Priority: HIGHEST for action port [ 620.606514] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0e120e-fe1d-452e-84f0-0230ee3bbe00 with Priority: HIGHEST for action port [ 620.607150] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d0e120e-fe1d-452e-84f0-0230ee3bbe00 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.607292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d0e120e-fe1d-452e-84f0-0230ee3bbe00" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.607379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d0e120e-fe1d-452e-84f0-0230ee3bbe00" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.607687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d0e120e-fe1d-452e-84f0-0230ee3bbe00" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.608224] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d0e120e-fe1d-452e-84f0-0230ee3bbe00',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.692037] env[63014]: INFO networking_nsxv3.common.synchronization [None req-15f887e2-a206-48c7-a6a9-5a8d7191a51c None None] Enqueued Resource ID: 86128625-8a66-45da-a894-42a2a040eef9 with Priority: HIGHEST for action port [ 620.692381] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86128625-8a66-45da-a894-42a2a040eef9 with Priority: HIGHEST for action port [ 620.692703] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-86128625-8a66-45da-a894-42a2a040eef9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.692825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86128625-8a66-45da-a894-42a2a040eef9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.692896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86128625-8a66-45da-a894-42a2a040eef9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.694025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86128625-8a66-45da-a894-42a2a040eef9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.694149] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86128625-8a66-45da-a894-42a2a040eef9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.733870] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.734137] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.734279] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.734605] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.734788] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.734977] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 11ec4696-291e-43e6-8fae-c07a38137745 not found, creating... [ 620.735318] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.735505] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.735655] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.735915] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.736065] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.736388] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.736588] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.736721] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.737582] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.737762] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.737939] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 11ec4696-291e-43e6-8fae-c07a38137745 is going to be created. [ 620.740779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.740892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.740968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.741336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.741453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.741549] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 already deleted. [ 620.741652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.741803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.741973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.742068] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.764586] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.764848] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.765009] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.765328] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.765572] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.765903] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-11ec4696-291e-43e6-8fae-c07a38137745" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.871049] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba in Status: SUCCESS [ 620.871049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.112180] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d0e120e-fe1d-452e-84f0-0230ee3bbe00 [ 621.112180] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.114277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.114277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.114277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.114277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.114277] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d0e120e-fe1d-452e-84f0-0230ee3bbe00 already deleted. [ 621.114277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d0e120e-fe1d-452e-84f0-0230ee3bbe00" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.197308] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86128625-8a66-45da-a894-42a2a040eef9 [ 621.198040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.199651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.199651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.199651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.199651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.199915] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86128625-8a66-45da-a894-42a2a040eef9 already deleted. [ 621.200520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86128625-8a66-45da-a894-42a2a040eef9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.266192] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.266387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.266499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.268589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.268589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.268589] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 already deleted. [ 621.268819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.791023] env[63014]: INFO networking_nsxv3.common.synchronization [None req-256e9bd9-0e32-4a60-b09b-d939d9393070 None None] Enqueued Resource ID: 173bc074-9cd5-4702-a914-3b36f425dfb6 with Priority: HIGHEST for action port [ 621.791023] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 173bc074-9cd5-4702-a914-3b36f425dfb6 with Priority: HIGHEST for action port [ 621.791023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-173bc074-9cd5-4702-a914-3b36f425dfb6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.791023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-173bc074-9cd5-4702-a914-3b36f425dfb6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.791023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-173bc074-9cd5-4702-a914-3b36f425dfb6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.791023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-173bc074-9cd5-4702-a914-3b36f425dfb6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.791023] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('173bc074-9cd5-4702-a914-3b36f425dfb6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.018052] env[63014]: INFO networking_nsxv3.common.synchronization [req-edb49c75-6c80-42c0-ba33-bbc51975ac06 req-10327520-d26c-466d-9b1f-af4cb47a9a33 service nova] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_rules [ 622.018623] env[63014]: INFO networking_nsxv3.common.synchronization [req-edb49c75-6c80-42c0-ba33-bbc51975ac06 req-10327520-d26c-466d-9b1f-af4cb47a9a33 service nova] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 622.018810] env[63014]: INFO networking_nsxv3.common.synchronization [req-edb49c75-6c80-42c0-ba33-bbc51975ac06 req-10327520-d26c-466d-9b1f-af4cb47a9a33 service nova] Enqueued Resource ID: 11ec4696-291e-43e6-8fae-c07a38137745 with Priority: HIGHEST for action port [ 622.021250] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_rules [ 622.021250] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 622.021250] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ec4696-291e-43e6-8fae-c07a38137745 with Priority: HIGHEST for action port [ 622.021250] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.021250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.021250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.021250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.021250] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.022728] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.022842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.022905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.023383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.023761] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.023917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.024154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.024493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.024493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.024632] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.025656] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-11ec4696-291e-43e6-8fae-c07a38137745 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.025795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11ec4696-291e-43e6-8fae-c07a38137745" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.025855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11ec4696-291e-43e6-8fae-c07a38137745" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.029284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11ec4696-291e-43e6-8fae-c07a38137745" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.029434] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11ec4696-291e-43e6-8fae-c07a38137745',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.207141] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 in Status: SUCCESS [ 622.207380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.218051] env[63014]: INFO networking_nsxv3.common.synchronization [req-93dedf58-9373-4d9b-b88c-dc1fe2fd8576 req-9a116de6-46fa-4693-8f2e-e9500f5f7d47 tempest-ServersAdminTestJSON-1268263957 tempest-ServersAdminTestJSON-1268263957-project-member] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 622.218533] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 622.219681] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.219681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.219681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.219681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.219681] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.219681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.219681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.219681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.220591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.220591] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.292855] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 173bc074-9cd5-4702-a914-3b36f425dfb6 [ 622.293106] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.293243] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.293313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.293572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.293666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.293764] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:173bc074-9cd5-4702-a914-3b36f425dfb6 already deleted. [ 622.293864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-173bc074-9cd5-4702-a914-3b36f425dfb6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.531789] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11ec4696-291e-43e6-8fae-c07a38137745 with status ACTIVE [ 622.532811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.532961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.533047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.533276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.533366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.533588] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.533687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.533752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.533915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.533988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.534183] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.534273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.534330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.534481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.534551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.534634] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11ec4696-291e-43e6-8fae-c07a38137745 is going to be updated. [ 622.535858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.536017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.536735] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.558713] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.559111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.559197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.559401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.559523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.559842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11ec4696-291e-43e6-8fae-c07a38137745" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.724887] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.039232] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.227871] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.327276] env[63014]: INFO networking_nsxv3.common.synchronization [None req-53f4b5f7-9f59-4674-a22f-f708b376ea0f None None] Enqueued Resource ID: e1195ddc-ac01-4c6b-8d20-85f7ab31004a with Priority: HIGHEST for action port [ 623.327276] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1195ddc-ac01-4c6b-8d20-85f7ab31004a with Priority: HIGHEST for action port [ 623.327689] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1195ddc-ac01-4c6b-8d20-85f7ab31004a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.327839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1195ddc-ac01-4c6b-8d20-85f7ab31004a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.327907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1195ddc-ac01-4c6b-8d20-85f7ab31004a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.328193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1195ddc-ac01-4c6b-8d20-85f7ab31004a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.328269] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1195ddc-ac01-4c6b-8d20-85f7ab31004a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.401995] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.404020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.404020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.404020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.406201] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.406402] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.406544] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.406880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.407103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.407346] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.407498] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.407629] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.407772] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.408022] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.408022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.409252] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.430682] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.430682] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 623.430682] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.430682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.430682] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-58e14038-b466-49ea-89b5-9051a9d91c64 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.430682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-58e14038-b466-49ea-89b5-9051a9d91c64" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.430682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-58e14038-b466-49ea-89b5-9051a9d91c64" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.430682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-58e14038-b466-49ea-89b5-9051a9d91c64" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.430682] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58e14038-b466-49ea-89b5-9051a9d91c64',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.543602] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.543694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.543694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.543938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.544023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.544119] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be created. [ 623.566508] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.566662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.566711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.566913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.567079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.579469] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: UNINITIALIZED for 2s [ 623.659530] env[63014]: INFO networking_nsxv3.common.synchronization [req-f3852d21-47f2-4dda-8819-46b620242f27 req-304dd494-91d2-4353-8c48-cce190f7af80 tempest-SecurityGroupRulesTestJSON-299309072 tempest-SecurityGroupRulesTestJSON-299309072-project-member] Enqueued Resource ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d with Priority: HIGHEST for action security_group_rules [ 623.660085] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d with Priority: HIGHEST for action security_group_rules [ 623.660297] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.660297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.660297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.661095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.661645] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c9cf2e-ee4d-4313-a20d-153b95684b1d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.731207] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.731422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.731422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.732073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.732073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.732073] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 623.762714] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.762940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.763054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.763351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.763554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.772065] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 623.837279] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1195ddc-ac01-4c6b-8d20-85f7ab31004a [ 623.837664] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.837806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.837877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.838691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.838897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.838897] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1195ddc-ac01-4c6b-8d20-85f7ab31004a already deleted. [ 623.839046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1195ddc-ac01-4c6b-8d20-85f7ab31004a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.885132] env[63014]: INFO networking_nsxv3.common.synchronization [None req-68b6fb9c-112c-483d-b76d-a3c3dfab84c5 None None] Enqueued Resource ID: 9557e4a7-e5ef-46e4-882b-96d185eb5a4e with Priority: HIGHEST for action port [ 623.885132] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9557e4a7-e5ef-46e4-882b-96d185eb5a4e with Priority: HIGHEST for action port [ 623.885132] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-9557e4a7-e5ef-46e4-882b-96d185eb5a4e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.885132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9557e4a7-e5ef-46e4-882b-96d185eb5a4e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.885412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9557e4a7-e5ef-46e4-882b-96d185eb5a4e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.886398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9557e4a7-e5ef-46e4-882b-96d185eb5a4e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.886398] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9557e4a7-e5ef-46e4-882b-96d185eb5a4e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.933696] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.933918] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.934055] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.934350] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.934759] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.934759] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 58e14038-b466-49ea-89b5-9051a9d91c64 not found, creating... [ 623.935034] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.935572] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.935572] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.935572] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.935721] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.936467] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.936467] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.936467] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.936467] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.936681] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.938863] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 58e14038-b466-49ea-89b5-9051a9d91c64 is going to be created. [ 623.959064] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.959064] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.959064] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.959257] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.959420] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.959654] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-58e14038-b466-49ea-89b5-9051a9d91c64" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.189953] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.190313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.190313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.190450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.190672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.190672] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c9cf2e-ee4d-4313-a20d-153b95684b1d already deleted. [ 624.190812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c9cf2e-ee4d-4313-a20d-153b95684b1d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.375204] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d9201691-a089-4694-a1a7-8def4176e2d3 None None] Enqueued Resource ID: 177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5 with Priority: HIGHEST for action port [ 624.375418] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5 with Priority: HIGHEST for action port [ 624.376512] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.376512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.376512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.376512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.376512] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.391035] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9557e4a7-e5ef-46e4-882b-96d185eb5a4e [ 624.391035] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.391035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.391035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.391035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.391035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.391035] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9557e4a7-e5ef-46e4-882b-96d185eb5a4e already deleted. [ 624.391504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9557e4a7-e5ef-46e4-882b-96d185eb5a4e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.878833] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5 [ 624.880339] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.881669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.881669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.881669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.881669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.881669] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5 already deleted. [ 624.881669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-177b53cf-9ab1-483a-b3b7-4e9c3d2ac8b5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.883975] env[63014]: INFO networking_nsxv3.common.synchronization [req-93dedf58-9373-4d9b-b88c-dc1fe2fd8576 req-347b19c6-0f9e-42d7-b14a-d4ad1713da20 service nova] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_rules [ 624.884956] env[63014]: INFO networking_nsxv3.common.synchronization [req-93dedf58-9373-4d9b-b88c-dc1fe2fd8576 req-347b19c6-0f9e-42d7-b14a-d4ad1713da20 service nova] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 624.885617] env[63014]: INFO networking_nsxv3.common.synchronization [req-93dedf58-9373-4d9b-b88c-dc1fe2fd8576 req-347b19c6-0f9e-42d7-b14a-d4ad1713da20 service nova] Enqueued Resource ID: 58e14038-b466-49ea-89b5-9051a9d91c64 with Priority: HIGHEST for action port [ 624.888576] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_rules [ 624.888576] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 624.888576] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58e14038-b466-49ea-89b5-9051a9d91c64 with Priority: HIGHEST for action port [ 624.888576] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.888576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.888576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.888576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.888576] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.890779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.890779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.890779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-58e14038-b466-49ea-89b5-9051a9d91c64 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.890779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58e14038-b466-49ea-89b5-9051a9d91c64" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.890779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58e14038-b466-49ea-89b5-9051a9d91c64" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.890779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58e14038-b466-49ea-89b5-9051a9d91c64" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.890779] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58e14038-b466-49ea-89b5-9051a9d91c64',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.052479] env[63014]: INFO networking_nsxv3.common.synchronization [None req-2be9ea61-4b21-42c9-a287-59ed68fadb87 None None] Enqueued Resource ID: 85506490-fffc-4d06-8829-ec24dfefb441 with Priority: HIGHEST for action port [ 625.052479] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85506490-fffc-4d06-8829-ec24dfefb441 with Priority: HIGHEST for action port [ 625.055066] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-85506490-fffc-4d06-8829-ec24dfefb441 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.055066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85506490-fffc-4d06-8829-ec24dfefb441" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.055066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85506490-fffc-4d06-8829-ec24dfefb441" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.055066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85506490-fffc-4d06-8829-ec24dfefb441" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.055066] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85506490-fffc-4d06-8829-ec24dfefb441',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.396294] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.396294] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58e14038-b466-49ea-89b5-9051a9d91c64 with status ACTIVE [ 625.396294] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.396294] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.396294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.396294] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.397022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.397022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.397022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.397022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.397022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58e14038-b466-49ea-89b5-9051a9d91c64 is going to be updated. [ 625.415216] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.415216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.415216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.415405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.415530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.415819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58e14038-b466-49ea-89b5-9051a9d91c64" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.557188] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85506490-fffc-4d06-8829-ec24dfefb441 [ 625.557283] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.557703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.557703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.557810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.557931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.558078] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85506490-fffc-4d06-8829-ec24dfefb441 already deleted. [ 625.558152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85506490-fffc-4d06-8829-ec24dfefb441" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.591075] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: SUCCESS [ 625.591075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.595372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.595372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.595372] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.595372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.595372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.595372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.595372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.595372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.595372] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.783127] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 625.783704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.783704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.783835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.784049] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.784761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.784761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.784761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.784761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.784761] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.886421] env[63014]: INFO networking_nsxv3.common.synchronization [None req-cdc9fea0-da4f-4852-b517-09c224068c4d None None] Enqueued Resource ID: 0cd09519-18ee-4855-962b-55b2d9eb88a1 with Priority: HIGHEST for action port [ 625.886421] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cd09519-18ee-4855-962b-55b2d9eb88a1 with Priority: HIGHEST for action port [ 625.886705] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cd09519-18ee-4855-962b-55b2d9eb88a1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.886802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cd09519-18ee-4855-962b-55b2d9eb88a1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.886853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cd09519-18ee-4855-962b-55b2d9eb88a1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.887334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cd09519-18ee-4855-962b-55b2d9eb88a1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.887446] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cd09519-18ee-4855-962b-55b2d9eb88a1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.098470] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.098470] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.098470] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.098470] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.098470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.099218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.099218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.099218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.099218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.099218] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.288088] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.397299] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cd09519-18ee-4855-962b-55b2d9eb88a1 [ 626.397666] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.397758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.397824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.398060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.398149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.398252] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cd09519-18ee-4855-962b-55b2d9eb88a1 already deleted. [ 626.398333] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cd09519-18ee-4855-962b-55b2d9eb88a1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.499872] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ba973140-4745-43b3-960f-edf43ea35946 tempest-ServersTestManualDisk-740044999 tempest-ServersTestManualDisk-740044999-project-member] Enqueued Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_rules [ 626.502486] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_rules [ 626.502486] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.502486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.502486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.502486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.502486] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.602425] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b654582e-9aa5-4cb5-919f-974e7b4e9f66: rpc.has_security_group_logging(os_id): False [ 626.620260] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.620730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.620730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.620730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.620885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.621014] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.621136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.621206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.621446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.621446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.621658] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.621752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.621811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.621978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.622095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.622317] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.622415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.622479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.622617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.622737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.622812] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be created. [ 626.677651] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.677651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.677651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.677651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.677651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.688477] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: IN_PROGRESS for 2s [ 626.793919] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.801108] env[63014]: INFO networking_nsxv3.common.synchronization [None req-afaa3743-2b10-4ef3-98ed-ddf2edaa10cd tempest-ServersTestManualDisk-740044999 tempest-ServersTestManualDisk-740044999-project-member] Enqueued Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_rules [ 626.801747] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_rules [ 626.803060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.803198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.021937] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.022124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.022196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.022423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.022527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.022635] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 already deleted. [ 627.022720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.022893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.023032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.023117] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.093377] env[63014]: INFO networking_nsxv3.common.synchronization [req-f8849245-f333-4959-94be-90d745f2158d req-a36b1f97-dc3e-4d8d-96bc-739d1ce7a9cf tempest-ServersTestFqdnHostnames-1394113230 tempest-ServersTestFqdnHostnames-1394113230-project-member] Enqueued Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_members [ 627.093377] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_members [ 627.093659] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd91700-654d-4bc1-8b27-185db0eb3543 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.093725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.093836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.096080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.096080] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.096080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.096080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.096080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.096080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.096080] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.295736] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.295736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.295929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.296047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.296140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.296703] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 627.330643] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.330643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.330643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.330643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.330958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.342121] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 627.547017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.547260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.547260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.548937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.548937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.548937] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 already deleted. [ 627.548937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.601269] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.601464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.601545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.601739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.601831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.602051] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.602136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.602197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.602342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.602416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.602509] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd91700-654d-4bc1-8b27-185db0eb3543 already deleted. [ 627.602587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.768233] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-136 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.768233] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-136" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.768233] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-136" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.768795] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-136" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.769062] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.773025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.773025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.773025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.773025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.773025] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.773025] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.773025] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.773025] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.773025] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 627.773025] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.773025] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.795532] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.795874] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 627.795874] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.796035] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-136" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.796439] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-6b1a23b5-fdee-41c0-a030-f445e84c8480 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.796553] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-6b1a23b5-fdee-41c0-a030-f445e84c8480" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.797518] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-6b1a23b5-fdee-41c0-a030-f445e84c8480" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.797518] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-6b1a23b5-fdee-41c0-a030-f445e84c8480" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.797518] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b1a23b5-fdee-41c0-a030-f445e84c8480',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.303616] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.303910] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.304118] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.304492] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.304711] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.307346] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 6b1a23b5-fdee-41c0-a030-f445e84c8480 not found, creating... [ 628.308206] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.309723] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.309723] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.309723] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.309723] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.309723] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.309723] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.309723] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.310358] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.312667] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.312667] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 6b1a23b5-fdee-41c0-a030-f445e84c8480 is going to be created. [ 628.330374] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.330603] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.330738] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.331055] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.332787] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.332787] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-6b1a23b5-fdee-41c0-a030-f445e84c8480" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.701061] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: SUCCESS [ 628.701375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.269245] env[63014]: INFO networking_nsxv3.common.synchronization [None req-24289dff-3aa0-4f55-b791-12114201415f None None] Enqueued Resource ID: d7424493-263d-49db-93b6-679aba644f93 with Priority: HIGHEST for action port [ 629.269245] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7424493-263d-49db-93b6-679aba644f93 with Priority: HIGHEST for action port [ 629.269245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7424493-263d-49db-93b6-679aba644f93 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.269245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7424493-263d-49db-93b6-679aba644f93" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.269245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7424493-263d-49db-93b6-679aba644f93" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.269245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7424493-263d-49db-93b6-679aba644f93" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.269245] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7424493-263d-49db-93b6-679aba644f93',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.316212] env[63014]: INFO networking_nsxv3.common.synchronization [req-f8849245-f333-4959-94be-90d745f2158d req-12abe331-9b9a-4f11-92db-b383dfa72acf service nova] Enqueued Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_rules [ 629.316212] env[63014]: INFO networking_nsxv3.common.synchronization [req-f8849245-f333-4959-94be-90d745f2158d req-12abe331-9b9a-4f11-92db-b383dfa72acf service nova] Enqueued Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_members [ 629.316212] env[63014]: INFO networking_nsxv3.common.synchronization [req-f8849245-f333-4959-94be-90d745f2158d req-12abe331-9b9a-4f11-92db-b383dfa72acf service nova] Enqueued Resource ID: 6b1a23b5-fdee-41c0-a030-f445e84c8480 with Priority: HIGHEST for action port [ 629.316212] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_rules [ 629.316212] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_members [ 629.316212] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b1a23b5-fdee-41c0-a030-f445e84c8480 with Priority: HIGHEST for action port [ 629.318826] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd91700-654d-4bc1-8b27-185db0eb3543 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.319023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.319023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.319256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.320354] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.320805] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd91700-654d-4bc1-8b27-185db0eb3543 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.320805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.320963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.321665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.321665] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.321665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.321665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.321665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.322141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.322141] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.323278] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b1a23b5-fdee-41c0-a030-f445e84c8480 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.323278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b1a23b5-fdee-41c0-a030-f445e84c8480" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.323278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b1a23b5-fdee-41c0-a030-f445e84c8480" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.323587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b1a23b5-fdee-41c0-a030-f445e84c8480" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.323587] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b1a23b5-fdee-41c0-a030-f445e84c8480',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.358309] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 629.358309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.358992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.359344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.359462] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.359562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.359626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.359767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.359845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.359934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.360038] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.771320] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7424493-263d-49db-93b6-679aba644f93 [ 629.771627] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.771752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.772162] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.772400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.772572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.772682] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7424493-263d-49db-93b6-679aba644f93 already deleted. [ 629.772771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7424493-263d-49db-93b6-679aba644f93" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.830077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd91700-654d-4bc1-8b27-185db0eb3543 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.830352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.830741] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.832967] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b1a23b5-fdee-41c0-a030-f445e84c8480 with status ACTIVE [ 629.832967] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.832967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.832967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.832967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.833339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.833339] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.834421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.834421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.835317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.835317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.835752] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.835927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.836397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.836900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.837600] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b1a23b5-fdee-41c0-a030-f445e84c8480 is going to be updated. [ 629.862770] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.863232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.863232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.863609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.863706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.863973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b1a23b5-fdee-41c0-a030-f445e84c8480" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.867347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.868817] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.868817] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.868817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.869383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.869383] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.869383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.869383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.869383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.869383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.869594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.869594] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.341402] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.376020] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b31bea8a-6eb8-474e-9f80-c659e23a5477: rpc.has_security_group_logging(os_id): False [ 630.393339] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.393532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.393613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.393825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.393917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.394191] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.394295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.394353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.394532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.394644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.394913] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.395021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.395085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.395233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.396410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.396638] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.397123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.397123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.397123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.397123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.397334] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 630.455283] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.455439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.455509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.455731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.455873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.468741] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 630.844572] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.844907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.845020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.846138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.846241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.846437] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd91700-654d-4bc1-8b27-185db0eb3543 is going to be created. [ 630.871069] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.871595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.871939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.871939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.872880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.880684] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd91700-654d-4bc1-8b27-185db0eb3543 in Status: UNINITIALIZED for 2s [ 631.933239] env[63014]: INFO networking_nsxv3.common.synchronization [None req-23db0329-f611-4060-a277-ffdbf6a264d5 None None] Enqueued Resource ID: 51496ed1-c7e2-4c9a-8fad-ae1cda49891e with Priority: HIGHEST for action port [ 631.933497] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51496ed1-c7e2-4c9a-8fad-ae1cda49891e with Priority: HIGHEST for action port [ 631.934207] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-51496ed1-c7e2-4c9a-8fad-ae1cda49891e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.934327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51496ed1-c7e2-4c9a-8fad-ae1cda49891e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.934390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51496ed1-c7e2-4c9a-8fad-ae1cda49891e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.934682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51496ed1-c7e2-4c9a-8fad-ae1cda49891e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.934762] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51496ed1-c7e2-4c9a-8fad-ae1cda49891e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.438144] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51496ed1-c7e2-4c9a-8fad-ae1cda49891e [ 632.438399] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.438543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.438606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.438830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.438930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.439032] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51496ed1-c7e2-4c9a-8fad-ae1cda49891e already deleted. [ 632.439254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51496ed1-c7e2-4c9a-8fad-ae1cda49891e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.483232] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 632.483541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.889779] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd91700-654d-4bc1-8b27-185db0eb3543 in Status: SUCCESS [ 632.889991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.890167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.890465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.890555] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.890682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.890741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.890917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.891008] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.891815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.892095] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.395059] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.600695] env[63014]: INFO networking_nsxv3.common.synchronization [req-82e00883-8f46-4dc8-9c1b-0afba75f8fe3 req-e8be2c02-33b7-418a-9e4d-43b4fe98ab38 tempest-DeleteServersAdminTestJSON-1653377477 tempest-DeleteServersAdminTestJSON-1653377477-project-member] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 633.601441] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 633.601858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.602023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.602114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.602352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.602533] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.602657] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.602736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.602919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.603053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.603170] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.897285] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for efd91700-654d-4bc1-8b27-185db0eb3543: rpc.has_security_group_logging(os_id): False [ 633.919022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.919022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.919022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.919022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.919022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.919022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.919022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.919022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.919022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.919022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.919022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd91700-654d-4bc1-8b27-185db0eb3543 is going to be created. [ 633.980484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.980689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.980777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.981031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.981292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.995021] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd91700-654d-4bc1-8b27-185db0eb3543 in Status: IN_PROGRESS for 2s [ 634.107430] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.107629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.107698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.108732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.108732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.108732] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.108732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.108732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.108732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.108732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.108732] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 is going to be updated. [ 634.149303] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.149303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.149303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.150451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.150661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.161538] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: IN_PROGRESS for 2s [ 634.210083] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.210271] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.210394] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.210685] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.210938] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.211107] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.211226] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.211440] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.211588] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.211791] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 634.211907] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.212024] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.212135] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.212329] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 634.212459] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.212500] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.240297] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.240297] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 634.240297] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.240297] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.240297] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-cdeadc28-c91e-4bf8-a700-982137b09765 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.240297] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-cdeadc28-c91e-4bf8-a700-982137b09765" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.240297] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-cdeadc28-c91e-4bf8-a700-982137b09765" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.240297] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-cdeadc28-c91e-4bf8-a700-982137b09765" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.240297] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdeadc28-c91e-4bf8-a700-982137b09765',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.409070] env[63014]: INFO networking_nsxv3.common.synchronization [None req-6b375dd6-b052-4566-b89b-b6e047012e0c None None] Enqueued Resource ID: 73a21ce7-46a0-4467-a278-a020545722bd with Priority: HIGHEST for action port [ 634.409435] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a21ce7-46a0-4467-a278-a020545722bd with Priority: HIGHEST for action port [ 634.409785] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-73a21ce7-46a0-4467-a278-a020545722bd taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.409785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73a21ce7-46a0-4467-a278-a020545722bd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.410076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73a21ce7-46a0-4467-a278-a020545722bd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.412940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73a21ce7-46a0-4467-a278-a020545722bd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.412940] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73a21ce7-46a0-4467-a278-a020545722bd',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.559932] env[63014]: INFO networking_nsxv3.common.synchronization [None req-f9afd6cc-95de-4a68-9c43-ef5ce8ab0699 None None] Enqueued Resource ID: c119f6b5-9deb-40ea-89e2-c2767c5edeb7 with Priority: HIGHEST for action port [ 634.560589] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c119f6b5-9deb-40ea-89e2-c2767c5edeb7 with Priority: HIGHEST for action port [ 634.560844] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-c119f6b5-9deb-40ea-89e2-c2767c5edeb7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.560963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c119f6b5-9deb-40ea-89e2-c2767c5edeb7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.561204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c119f6b5-9deb-40ea-89e2-c2767c5edeb7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.561534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c119f6b5-9deb-40ea-89e2-c2767c5edeb7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.561619] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c119f6b5-9deb-40ea-89e2-c2767c5edeb7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.745019] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.745513] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.745656] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.746173] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.746440] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.746794] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port cdeadc28-c91e-4bf8-a700-982137b09765 not found, creating... [ 634.747367] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.747534] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.747670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.747943] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.748565] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.749286] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.749615] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.749828] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.750225] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.750390] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.750536] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: cdeadc28-c91e-4bf8-a700-982137b09765 is going to be created. [ 634.771689] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.771990] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.772196] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.772540] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.772833] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.773174] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-cdeadc28-c91e-4bf8-a700-982137b09765" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.916179] env[63014]: INFO networking_nsxv3.common.synchronization [req-1a4c87e9-2724-442d-ba03-9880b2d7f36e req-c93244ad-81f9-41dd-bd0d-4582dc795e8a tempest-InstanceActionsNegativeTestJSON-1007421309 tempest-InstanceActionsNegativeTestJSON-1007421309-project-member] Enqueued Resource ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 with Priority: HIGHEST for action security_group_members [ 634.916370] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73a21ce7-46a0-4467-a278-a020545722bd [ 634.916789] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.916789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.916789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.917088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.917088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.917088] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73a21ce7-46a0-4467-a278-a020545722bd already deleted. [ 634.918098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73a21ce7-46a0-4467-a278-a020545722bd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.918897] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 with Priority: HIGHEST for action security_group_members [ 634.919151] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-22d88dc5-1e20-4ce5-b224-a55bea6c2304 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.919324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.919429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.919664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.919887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.920046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.920144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.920342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.920464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.920595] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('22d88dc5-1e20-4ce5-b224-a55bea6c2304',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.067484] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c119f6b5-9deb-40ea-89e2-c2767c5edeb7 [ 635.067765] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.067765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.067888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.068257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.068257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.068391] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c119f6b5-9deb-40ea-89e2-c2767c5edeb7 already deleted. [ 635.068460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c119f6b5-9deb-40ea-89e2-c2767c5edeb7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.423317] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.423648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.423648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.423889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.424175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.424175] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.424326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.424326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.424539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.424618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.424828] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 is going to be updated. [ 635.451239] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.451406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.451488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.452118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.452118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.460648] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 in Status: IN_PROGRESS for 2s [ 635.765326] env[63014]: INFO networking_nsxv3.common.synchronization [req-82e00883-8f46-4dc8-9c1b-0afba75f8fe3 req-d8ed59c4-aa7d-40e0-a9b6-9a2f813d8f22 service nova] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_rules [ 635.765521] env[63014]: INFO networking_nsxv3.common.synchronization [req-82e00883-8f46-4dc8-9c1b-0afba75f8fe3 req-d8ed59c4-aa7d-40e0-a9b6-9a2f813d8f22 service nova] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 635.768390] env[63014]: INFO networking_nsxv3.common.synchronization [req-82e00883-8f46-4dc8-9c1b-0afba75f8fe3 req-d8ed59c4-aa7d-40e0-a9b6-9a2f813d8f22 service nova] Enqueued Resource ID: cdeadc28-c91e-4bf8-a700-982137b09765 with Priority: HIGHEST for action port [ 635.768390] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_rules [ 635.768390] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 635.771525] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdeadc28-c91e-4bf8-a700-982137b09765 with Priority: HIGHEST for action port [ 635.771525] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.771694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.771785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.772099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.772185] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.774667] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.774667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.775135] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdeadc28-c91e-4bf8-a700-982137b09765 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.775135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdeadc28-c91e-4bf8-a700-982137b09765" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.775264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdeadc28-c91e-4bf8-a700-982137b09765" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.775732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdeadc28-c91e-4bf8-a700-982137b09765" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.775732] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdeadc28-c91e-4bf8-a700-982137b09765',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.008163] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: efd91700-654d-4bc1-8b27-185db0eb3543 in Status: SUCCESS [ 636.008298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.173787] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: SUCCESS [ 636.173977] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 deletion is rescheduled due to dependency. [ 636.174111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.174279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.174508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.174699] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.174854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.175012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.175214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.175304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.175391] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.277963] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.278139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.280347] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdeadc28-c91e-4bf8-a700-982137b09765 with status ACTIVE [ 636.280568] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.280773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.280773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.280931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.281035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.281211] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.281306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.281362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.281708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.281708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.286525] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.286525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.286525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.286525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.286525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.286525] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdeadc28-c91e-4bf8-a700-982137b09765 is going to be updated. [ 636.303436] env[63014]: INFO networking_nsxv3.common.synchronization [None req-6067c475-b1bb-4384-96c8-f8baec1ef80e None None] Enqueued Resource ID: e93ef385-3ebf-41b6-9c33-b60646e1c8ff with Priority: HIGHEST for action port [ 636.305220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.305220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.305220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.305220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.305220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.305220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdeadc28-c91e-4bf8-a700-982137b09765" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.305549] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e93ef385-3ebf-41b6-9c33-b60646e1c8ff with Priority: HIGHEST for action port [ 636.305946] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e93ef385-3ebf-41b6-9c33-b60646e1c8ff taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.306081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e93ef385-3ebf-41b6-9c33-b60646e1c8ff" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.306142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e93ef385-3ebf-41b6-9c33-b60646e1c8ff" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.306336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e93ef385-3ebf-41b6-9c33-b60646e1c8ff" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.306411] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e93ef385-3ebf-41b6-9c33-b60646e1c8ff',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.678831] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.809934] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e93ef385-3ebf-41b6-9c33-b60646e1c8ff [ 636.810199] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.810337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.810418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.810615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.810707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.810800] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e93ef385-3ebf-41b6-9c33-b60646e1c8ff already deleted. [ 636.810882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e93ef385-3ebf-41b6-9c33-b60646e1c8ff" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.099223] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ecafbbfa-6e26-4bdf-9305-7fc1590d72bf None None] Enqueued Resource ID: 6ae39a86-6468-4b66-ab28-8d8157fa97ed with Priority: HIGHEST for action port [ 637.099223] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ae39a86-6468-4b66-ab28-8d8157fa97ed with Priority: HIGHEST for action port [ 637.099223] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ae39a86-6468-4b66-ab28-8d8157fa97ed taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.099223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ae39a86-6468-4b66-ab28-8d8157fa97ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.099223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ae39a86-6468-4b66-ab28-8d8157fa97ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.099970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ae39a86-6468-4b66-ab28-8d8157fa97ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.100200] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ae39a86-6468-4b66-ab28-8d8157fa97ed',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.182690] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.470358] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 in Status: SUCCESS [ 637.470507] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 22d88dc5-1e20-4ce5-b224-a55bea6c2304 deletion is rescheduled due to dependency. [ 637.470627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-22d88dc5-1e20-4ce5-b224-a55bea6c2304" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.606019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ae39a86-6468-4b66-ab28-8d8157fa97ed [ 637.606019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.606019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.606019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.606019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.606019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.606019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ae39a86-6468-4b66-ab28-8d8157fa97ed already deleted. [ 637.606019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ae39a86-6468-4b66-ab28-8d8157fa97ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.686051] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.686362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.686362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.686516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.686609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.686722] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 is going to be updated. [ 637.716897] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.717109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.717224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.717391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.717678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.725561] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: IN_PROGRESS for 2s [ 638.598043] env[63014]: INFO networking_nsxv3.common.synchronization [req-5639dfe6-bdeb-43d9-975a-f2d89560aa23 req-e4e98858-f603-41a2-9425-aed7dcedaaeb tempest-ImagesOneServerNegativeTestJSON-1556540069 tempest-ImagesOneServerNegativeTestJSON-1556540069-project-member] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 638.598980] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 638.598980] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.599115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.599115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.599364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.599518] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.599626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.599689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.600750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.600750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.600750] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.998731] env[63014]: INFO networking_nsxv3.common.synchronization [None req-c79aa011-3c34-4af1-b175-4504b41c6507 None None] Enqueued Resource ID: 05580ffa-40d4-4d69-bb40-c2618ec85fbb with Priority: HIGHEST for action port [ 638.999507] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05580ffa-40d4-4d69-bb40-c2618ec85fbb with Priority: HIGHEST for action port [ 638.999897] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-05580ffa-40d4-4d69-bb40-c2618ec85fbb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.000296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05580ffa-40d4-4d69-bb40-c2618ec85fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.000520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05580ffa-40d4-4d69-bb40-c2618ec85fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.000711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05580ffa-40d4-4d69-bb40-c2618ec85fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.000842] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05580ffa-40d4-4d69-bb40-c2618ec85fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.104143] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.104414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.104414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.104886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.104886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.105064] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.105277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.105277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.105399] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.105501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.105605] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 already deleted. [ 639.106040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.220140] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.220140] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.220140] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.220140] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.222562] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.226037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.226037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.226037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.226037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.226037] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.226037] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.226037] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.226037] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.226037] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 639.226037] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.226037] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.247351] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.247669] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 639.247941] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.248220] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.248653] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-10df7287-d6c8-4d8a-b35e-dc26e599b418 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.248902] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-10df7287-d6c8-4d8a-b35e-dc26e599b418" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.249279] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-10df7287-d6c8-4d8a-b35e-dc26e599b418" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.249792] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-10df7287-d6c8-4d8a-b35e-dc26e599b418" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.250066] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10df7287-d6c8-4d8a-b35e-dc26e599b418',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.502865] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05580ffa-40d4-4d69-bb40-c2618ec85fbb [ 639.503119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.503259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.503323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.503559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.503659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.503757] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05580ffa-40d4-4d69-bb40-c2618ec85fbb already deleted. [ 639.503838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05580ffa-40d4-4d69-bb40-c2618ec85fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.736098] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: SUCCESS [ 639.736393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.736516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.736754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.736935] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.737081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.737128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.737313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.737403] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.737519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.737650] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.754786] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.755124] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.755290] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.755585] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.755734] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.755892] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 10df7287-d6c8-4d8a-b35e-dc26e599b418 not found, creating... [ 639.757344] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.757344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.757344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.757344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.757344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.757344] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.757344] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.757822] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.757822] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.757822] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.757946] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 10df7287-d6c8-4d8a-b35e-dc26e599b418 is going to be created. [ 639.778043] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.778043] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.780987] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.782144] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.782144] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.782144] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-10df7287-d6c8-4d8a-b35e-dc26e599b418" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.916135] env[63014]: INFO networking_nsxv3.common.synchronization [req-2398a01c-59e4-495f-8d49-3f800e4bdd7c req-8d1050f2-0cb2-4c42-a22b-b36730e995d5 tempest-FloatingIPsAssociationTestJSON-1182186772 tempest-FloatingIPsAssociationTestJSON-1182186772-project-member] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 639.917294] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 639.917967] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.920045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.920045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.920045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.920045] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.920045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.920045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.920045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.920539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.920539] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.245252] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.245599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.245599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.245774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.245990] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.246514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.246676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.246768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.246883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.246954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.247133] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.247230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.247287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.247595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.247595] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.247762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.247762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.247863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.247913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.248052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.248132] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.422688] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.526941] env[63014]: INFO networking_nsxv3.common.synchronization [req-5639dfe6-bdeb-43d9-975a-f2d89560aa23 req-38ec452d-1421-4546-9057-0e35958f8291 service nova] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_rules [ 640.527147] env[63014]: INFO networking_nsxv3.common.synchronization [req-5639dfe6-bdeb-43d9-975a-f2d89560aa23 req-38ec452d-1421-4546-9057-0e35958f8291 service nova] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 640.527285] env[63014]: INFO networking_nsxv3.common.synchronization [req-5639dfe6-bdeb-43d9-975a-f2d89560aa23 req-38ec452d-1421-4546-9057-0e35958f8291 service nova] Enqueued Resource ID: 10df7287-d6c8-4d8a-b35e-dc26e599b418 with Priority: HIGHEST for action port [ 640.527519] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_rules [ 640.527656] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 640.527751] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10df7287-d6c8-4d8a-b35e-dc26e599b418 with Priority: HIGHEST for action port [ 640.528307] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.528432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.528512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.528788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.528897] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.531390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.531559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.531629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.531830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.531965] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.532076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.532150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.532275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.532356] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.532459] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.536474] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-10df7287-d6c8-4d8a-b35e-dc26e599b418 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.536474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10df7287-d6c8-4d8a-b35e-dc26e599b418" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.536474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10df7287-d6c8-4d8a-b35e-dc26e599b418" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.536474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10df7287-d6c8-4d8a-b35e-dc26e599b418" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.536474] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10df7287-d6c8-4d8a-b35e-dc26e599b418',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.753980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db4cd683-9721-46bf-9f15-99f7cf241691: rpc.has_security_group_logging(os_id): False [ 640.778090] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.778265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.778265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.778479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.778585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.778783] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.778896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.778972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.779108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.779178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.779376] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.779469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.779529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.779698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.779804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.780155] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.781019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.781131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.781306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.781497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.781568] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 is going to be updated. [ 640.844555] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.844555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.844555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.844555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.845067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.860268] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: IN_PROGRESS for 2s [ 640.894841] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-87248fce-0b95-4228-93b3-f283a334eafa tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 640.894841] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 640.894999] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.895098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.895161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.895422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.895590] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.895678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.895744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.895936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.896081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.896141] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.924837] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.040325] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.040325] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.040325] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10df7287-d6c8-4d8a-b35e-dc26e599b418 with status ACTIVE [ 641.040325] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.040325] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.040325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.040915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.040915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.040915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.040915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.040915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.040915] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10df7287-d6c8-4d8a-b35e-dc26e599b418 is going to be updated. [ 641.065032] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.065032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.065032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.065032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.065032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.065032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10df7287-d6c8-4d8a-b35e-dc26e599b418" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.400395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.400395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.400395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.400395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.400395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.400395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.400395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.400395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.400964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.400964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.400964] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb already deleted. [ 641.400964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.427446] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.427446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.427446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.428127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.428238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.428346] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 is going to be updated. [ 641.455105] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.455316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.455316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.455625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.455775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.466197] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: IN_PROGRESS for 2s [ 641.546560] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.569058] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-36d1363f-c885-463b-82a2-11a8d405518a tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 641.569058] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 641.572889] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.572889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.572889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.572889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.572889] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.572889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.572889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.572889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.572889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.572889] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.053021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.053202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.053372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.053916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.053916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.053916] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be created. [ 642.073058] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.073226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.073291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.073465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.073650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.074122] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.074122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.074122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.075032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.075032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.075032] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb already deleted. [ 642.075032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.100712] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.100859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.101064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.101266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.101312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.118553] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: UNINITIALIZED for 2s [ 642.302258] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-068bd239-f9e4-4671-8586-88a7def45878 tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 642.302768] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 642.304195] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.304342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.304412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.304627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.304793] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.305023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.305023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.305152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.305215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.305324] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.807583] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.807583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.807937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.807992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.808166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.808895] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.808895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.809051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.809220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.809347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.809459] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb already deleted. [ 642.809559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.875187] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: SUCCESS [ 642.875453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.133554] env[63014]: INFO networking_nsxv3.common.synchronization [None req-dc849c1d-d11a-40ab-8052-593f1ec7831d None None] Enqueued Resource ID: 9cbf1961-2de3-4c0d-be05-86e699798ee7 with Priority: HIGHEST for action port [ 643.134434] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbf1961-2de3-4c0d-be05-86e699798ee7 with Priority: HIGHEST for action port [ 643.134789] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cbf1961-2de3-4c0d-be05-86e699798ee7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.134918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cbf1961-2de3-4c0d-be05-86e699798ee7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.134918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cbf1961-2de3-4c0d-be05-86e699798ee7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.136051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cbf1961-2de3-4c0d-be05-86e699798ee7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.136051] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbf1961-2de3-4c0d-be05-86e699798ee7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.447402] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-25 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.447619] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.447759] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.451777] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.451777] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.451777] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.451962] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.452405] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.452581] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.452809] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.454256] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.454256] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.454256] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.454256] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 643.454256] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.454256] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.473147] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.473315] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 643.473689] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.473689] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.473998] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-19c31e45-0828-4a6b-8ed8-10882d923cd3 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.474262] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-19c31e45-0828-4a6b-8ed8-10882d923cd3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.474383] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-19c31e45-0828-4a6b-8ed8-10882d923cd3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.474640] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-19c31e45-0828-4a6b-8ed8-10882d923cd3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.474853] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19c31e45-0828-4a6b-8ed8-10882d923cd3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.479559] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: SUCCESS [ 643.479782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.641696] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cbf1961-2de3-4c0d-be05-86e699798ee7 [ 643.641696] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.641879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.641879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.642345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.642345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.642345] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cbf1961-2de3-4c0d-be05-86e699798ee7 already deleted. [ 643.642495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cbf1961-2de3-4c0d-be05-86e699798ee7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.984791] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.984791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.984791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.984791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.984791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.984791] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 19c31e45-0828-4a6b-8ed8-10882d923cd3 not found, creating... [ 643.984791] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.984791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.984791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.984791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.984791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.985740] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.989334] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.989334] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.989334] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.989334] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.989334] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 19c31e45-0828-4a6b-8ed8-10882d923cd3 is going to be created. [ 644.008607] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.008930] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.009158] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.010656] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.010925] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.011194] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-19c31e45-0828-4a6b-8ed8-10882d923cd3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.126456] env[63014]: INFO networking_nsxv3.common.synchronization [req-544d3688-1396-47af-9123-d2fa061d6267 req-59f64c2a-70eb-4bf0-b750-3e8a9ca7b9f0 tempest-FloatingIPsAssociationNegativeTestJSON-168841279 tempest-FloatingIPsAssociationNegativeTestJSON-168841279-project-member] Enqueued Resource ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df with Priority: HIGHEST for action security_group_members [ 644.126456] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df with Priority: HIGHEST for action security_group_members [ 644.127466] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.127466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.127466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.127466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.127713] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.127773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.127811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.127940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.128043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.128386] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c3c5e73-32ea-4e2f-aecf-a8278a3549df',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.135770] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 644.135770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.136662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.136662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.136662] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.136830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.136830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.138551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.138551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.138551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.138551] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.631501] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.631755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.631840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.632069] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.632699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.632699] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.632699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.632699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.632699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.634091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.634091] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df already deleted. [ 644.634091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.639718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.641225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.641514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.641514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.641705] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.641816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.641880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.642055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.642140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.642249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.642437] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.642542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.642607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.642753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.642895] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.642989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.643062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.643207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.643286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.643367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.643457] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.147470] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08: rpc.has_security_group_logging(os_id): False [ 645.153663] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-406 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.154562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-406" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.154562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-406" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.154562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-406" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.154824] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.154932] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.155118] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.155419] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.155594] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.155824] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.155949] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.156099] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.156239] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.156398] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.156526] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.156719] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.167414] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.167644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.167754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.167938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.168082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.168358] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.168473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.168540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.168716] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.168869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.169010] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.169245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.169340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.169579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.169659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.170081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.170172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.170311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.170489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.170671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.170767] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be created. [ 645.174439] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.174631] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.174749] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.174991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-406" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.175349] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.175535] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.176108] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.176108] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.176277] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc497bcd-0d2b-4633-bf54-fdfe8dadba91',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.300273] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.300273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.300273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.300273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.300273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.311284] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 645.596900] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-6de53c1f-5b12-4566-95a9-29ecacc6f280 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 645.598115] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-6de53c1f-5b12-4566-95a9-29ecacc6f280 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 645.598115] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-6de53c1f-5b12-4566-95a9-29ecacc6f280 service nova] Enqueued Resource ID: 19c31e45-0828-4a6b-8ed8-10882d923cd3 with Priority: HIGHEST for action port [ 645.598115] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 645.598115] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 645.598115] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19c31e45-0828-4a6b-8ed8-10882d923cd3 with Priority: HIGHEST for action port [ 645.598504] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.598583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.598652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.598956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.599048] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.600741] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.600855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.600920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.601109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.601254] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.602742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.602742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.602742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.602742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.602742] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.602742] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-19c31e45-0828-4a6b-8ed8-10882d923cd3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.604280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19c31e45-0828-4a6b-8ed8-10882d923cd3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.604280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19c31e45-0828-4a6b-8ed8-10882d923cd3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.604280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19c31e45-0828-4a6b-8ed8-10882d923cd3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.605042] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19c31e45-0828-4a6b-8ed8-10882d923cd3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.686025] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.686025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.686025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.686025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.686025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.686025] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port dc497bcd-0d2b-4633-bf54-fdfe8dadba91 not found, creating... [ 645.686025] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.686025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.686025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.686025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.686025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.686464] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.686464] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.686464] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.686464] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.686464] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.686464] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: dc497bcd-0d2b-4633-bf54-fdfe8dadba91 is going to be created. [ 645.709889] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.710118] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.710386] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.711132] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.711132] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.711132] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.064914] env[63014]: INFO networking_nsxv3.common.synchronization [None req-7c12b2b4-cc61-4a32-863f-9b2dd610729a None None] Enqueued Resource ID: 5d1cab45-a21b-4865-8c6f-d016e10a975b with Priority: HIGHEST for action port [ 646.065105] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d1cab45-a21b-4865-8c6f-d016e10a975b with Priority: HIGHEST for action port [ 646.065699] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d1cab45-a21b-4865-8c6f-d016e10a975b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.065894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d1cab45-a21b-4865-8c6f-d016e10a975b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.065948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d1cab45-a21b-4865-8c6f-d016e10a975b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.066244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d1cab45-a21b-4865-8c6f-d016e10a975b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.066983] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d1cab45-a21b-4865-8c6f-d016e10a975b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.106119] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.107221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.107530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.107698] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19c31e45-0828-4a6b-8ed8-10882d923cd3 with status ACTIVE [ 646.107871] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.107983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.108059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.108260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.108348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.108517] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.108614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.108679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.108835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.108912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.113218] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.113218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.113218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.114263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.114363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.114532] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19c31e45-0828-4a6b-8ed8-10882d923cd3 is going to be updated. [ 646.136785] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.136785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.136785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.136785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.136785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.138080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19c31e45-0828-4a6b-8ed8-10882d923cd3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.159121] env[63014]: INFO networking_nsxv3.common.synchronization [None req-70f52b67-07c9-4cb1-abc8-2174dd711448 tempest-AttachVolumeTestJSON-1387786992 tempest-AttachVolumeTestJSON-1387786992-project-member] Enqueued Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_rules [ 646.159121] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_rules [ 646.159809] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.160067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.160208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.160527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.163479] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.571188] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d1cab45-a21b-4865-8c6f-d016e10a975b [ 646.571188] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.571188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.571188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.571188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.571188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.571188] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d1cab45-a21b-4865-8c6f-d016e10a975b already deleted. [ 646.571188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d1cab45-a21b-4865-8c6f-d016e10a975b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.581241] env[63014]: INFO networking_nsxv3.common.synchronization [None req-fffa9469-819b-4ede-965b-f3e61a3b2655 tempest-AttachVolumeTestJSON-1387786992 tempest-AttachVolumeTestJSON-1387786992-project-member] Enqueued Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_rules [ 646.581241] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_rules [ 646.581241] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.581241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.608531] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.682936] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.683133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.683177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.683376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.683463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.683660] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 already deleted. [ 646.683660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.683803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.683957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.684046] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.759428] env[63014]: INFO networking_nsxv3.common.synchronization [None req-c0000612-3683-4c81-954a-782c6f097716 None None] Enqueued Resource ID: 42e852df-d8b6-4bd2-997e-5fec8329f20e with Priority: HIGHEST for action port [ 646.759690] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42e852df-d8b6-4bd2-997e-5fec8329f20e with Priority: HIGHEST for action port [ 646.760257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-42e852df-d8b6-4bd2-997e-5fec8329f20e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.760370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42e852df-d8b6-4bd2-997e-5fec8329f20e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.760436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42e852df-d8b6-4bd2-997e-5fec8329f20e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.760708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42e852df-d8b6-4bd2-997e-5fec8329f20e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.760792] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42e852df-d8b6-4bd2-997e-5fec8329f20e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.111397] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.111530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.111651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.111980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.112098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.112256] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be created. [ 647.135806] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.136169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.136354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.136638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.136879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.148378] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: UNINITIALIZED for 2s [ 647.210454] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.210766] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.210766] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.211008] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.211089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.211204] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 already deleted. [ 647.211288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.241830] env[63014]: INFO networking_nsxv3.common.synchronization [req-e3d0406f-6d0c-42a3-af1e-11e0836502ee req-e5b1d2ba-4bd1-4d8b-b640-23c41b949e21 tempest-AttachVolumeShelveTestJSON-960433482 tempest-AttachVolumeShelveTestJSON-960433482-project-member] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_members [ 647.242421] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_members [ 647.242898] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.242898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.243109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.244694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.244694] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.244824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.244951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.245211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.245350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.245558] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.262120] env[63014]: INFO networking_nsxv3.common.synchronization [req-544d3688-1396-47af-9123-d2fa061d6267 req-ecdf3e86-76f5-46b7-8728-211e453824de service nova] Enqueued Resource ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df with Priority: HIGHEST for action security_group_rules [ 647.262306] env[63014]: INFO networking_nsxv3.common.synchronization [req-544d3688-1396-47af-9123-d2fa061d6267 req-ecdf3e86-76f5-46b7-8728-211e453824de service nova] Enqueued Resource ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df with Priority: HIGHEST for action security_group_members [ 647.262442] env[63014]: INFO networking_nsxv3.common.synchronization [req-544d3688-1396-47af-9123-d2fa061d6267 req-ecdf3e86-76f5-46b7-8728-211e453824de service nova] Enqueued Resource ID: dc497bcd-0d2b-4633-bf54-fdfe8dadba91 with Priority: HIGHEST for action port [ 647.264018] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df with Priority: HIGHEST for action security_group_rules [ 647.264018] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df with Priority: HIGHEST for action security_group_members [ 647.264018] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc497bcd-0d2b-4633-bf54-fdfe8dadba91 with Priority: HIGHEST for action port [ 647.264018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c3c5e73-32ea-4e2f-aecf-a8278a3549df taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.264327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.264383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.264655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.264742] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c3c5e73-32ea-4e2f-aecf-a8278a3549df',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.265789] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.265912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.265977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.266204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.266362] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.266460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.266519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.266723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.266751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.266843] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c3c5e73-32ea-4e2f-aecf-a8278a3549df',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.268529] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.268696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.268768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.268942] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.269048] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc497bcd-0d2b-4633-bf54-fdfe8dadba91',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.272490] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42e852df-d8b6-4bd2-997e-5fec8329f20e [ 647.272678] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.272799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.272863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.273069] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.273158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.273252] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42e852df-d8b6-4bd2-997e-5fec8329f20e already deleted. [ 647.273330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42e852df-d8b6-4bd2-997e-5fec8329f20e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.276432] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-273 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.276608] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-273" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.276729] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-273" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.277046] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-273" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.277310] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.277457] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.277568] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.277784] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.277931] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.278241] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.278346] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.278477] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.278639] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.278759] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 647.278865] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.279052] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.302226] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.302696] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 647.302873] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.303129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-273" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.303648] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-849d83d9-1e5d-4833-9845-ed8a9678c7fa taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.303866] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-849d83d9-1e5d-4833-9845-ed8a9678c7fa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.304052] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-849d83d9-1e5d-4833-9845-ed8a9678c7fa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.304954] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-849d83d9-1e5d-4833-9845-ed8a9678c7fa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.305176] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('849d83d9-1e5d-4833-9845-ed8a9678c7fa',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.327630] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 647.327877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.748814] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.748814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.748814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.748814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.748814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.748814] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.748814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.748814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.748814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.749165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.749165] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 already deleted. [ 647.749165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.773347] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c3c5e73-32ea-4e2f-aecf-a8278a3549df',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.774417] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.774514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.774728] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc497bcd-0d2b-4633-bf54-fdfe8dadba91 with status ACTIVE [ 647.774893] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.774995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.775073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.775266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.775351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.775599] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.775721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.775783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.775960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.777769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.777996] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.778110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.778174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.778332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.778410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.781105] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc497bcd-0d2b-4633-bf54-fdfe8dadba91 is going to be updated. [ 647.811491] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.812067] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.812534] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.813332] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.813702] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.814061] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 849d83d9-1e5d-4833-9845-ed8a9678c7fa not found, creating... [ 647.815017] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.815017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.815433] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.816086] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.816086] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.820991] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.822594] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.822594] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.825878] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.825878] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.825878] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 849d83d9-1e5d-4833-9845-ed8a9678c7fa is going to be created. [ 647.828326] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.828326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.828474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.828577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.828761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.828922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc497bcd-0d2b-4633-bf54-fdfe8dadba91" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.854223] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.854410] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.854543] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.854886] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.855143] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.855383] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-849d83d9-1e5d-4833-9845-ed8a9678c7fa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.283728] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c3c5e73-32ea-4e2f-aecf-a8278a3549df',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.785477] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.785616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.785685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.786158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.786158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.786158] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df is going to be created. [ 648.788559] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.788804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.788955] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.789455] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.790931] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.790931] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.790931] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.790931] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.790931] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.790931] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.790931] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.790931] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.790931] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.791248] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 648.791318] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.791510] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.810587] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.810754] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 648.810888] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.811097] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.811411] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-18e2ea98-76da-43b3-bab6-7673a7afb3bf taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.811582] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.811701] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.812048] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.812653] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e2ea98-76da-43b3-bab6-7673a7afb3bf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.816792] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.816900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.816978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.817196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.817358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.825295] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df in Status: UNINITIALIZED for 2s [ 648.909186] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-b4a619ea-dafc-471b-914b-cb73d341f5c0 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 648.909469] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-b4a619ea-dafc-471b-914b-cb73d341f5c0 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 648.909626] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-b4a619ea-dafc-471b-914b-cb73d341f5c0 service nova] Enqueued Resource ID: 849d83d9-1e5d-4833-9845-ed8a9678c7fa with Priority: HIGHEST for action port [ 648.909992] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 648.910325] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 648.910732] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 849d83d9-1e5d-4833-9845-ed8a9678c7fa with Priority: HIGHEST for action port [ 648.912469] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.912469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.912469] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.912469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.913110] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-849d83d9-1e5d-4833-9845-ed8a9678c7fa taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.917531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-849d83d9-1e5d-4833-9845-ed8a9678c7fa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.917531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-849d83d9-1e5d-4833-9845-ed8a9678c7fa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.917531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-849d83d9-1e5d-4833-9845-ed8a9678c7fa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.917531] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('849d83d9-1e5d-4833-9845-ed8a9678c7fa',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.160469] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 649.160976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.161845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.162146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.162356] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.163220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.163220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.163220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.163220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.163220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.163220] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.164082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.165684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.165684] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.165684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.165684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.165684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.165684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.165684] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.178297] env[63014]: INFO networking_nsxv3.common.synchronization [req-66f323d5-f364-4004-bee5-291b559fbd22 req-950c76da-c3f0-4d6e-b221-070ce46b16a4 tempest-DeleteServersAdminTestJSON-1653377477 tempest-DeleteServersAdminTestJSON-1653377477-project-member] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 649.178297] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGHEST for action security_group_members [ 649.178606] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.178741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.178823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.179668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.179768] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.180136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.180136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.180245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.180300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.180407] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.317307] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.317307] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.317307] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.317307] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.317307] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.317723] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 18e2ea98-76da-43b3-bab6-7673a7afb3bf not found, creating... [ 649.317893] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.318098] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.318237] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.318651] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.318718] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.319064] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.320328] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.320328] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.320328] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.320328] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.320328] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 18e2ea98-76da-43b3-bab6-7673a7afb3bf is going to be created. [ 649.340192] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.340418] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.340524] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.340877] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.341057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.341301] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.419427] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 849d83d9-1e5d-4833-9845-ed8a9678c7fa with status ACTIVE [ 649.419676] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.419813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.419909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.420227] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.420660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.420660] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.420660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.420757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.421858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.421858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.421858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.421858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.421858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.421858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.421858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.421858] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 849d83d9-1e5d-4833-9845-ed8a9678c7fa is going to be updated. [ 649.440720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.440879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.440953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.443102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.443102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.443102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-849d83d9-1e5d-4833-9845-ed8a9678c7fa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.557696] env[63014]: INFO networking_nsxv3.common.synchronization [req-42d1ab3a-9904-4f3e-bfb8-996ba2b85a8f req-10f0aa22-d5fb-403d-b337-1d51297da0eb tempest-ServerAddressesNegativeTestJSON-1906775353 tempest-ServerAddressesNegativeTestJSON-1906775353-project-member] Enqueued Resource ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 with Priority: HIGHEST for action security_group_members [ 649.561773] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 with Priority: HIGHEST for action security_group_members [ 649.562330] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4362ce77-85ac-42be-8249-4cf8afc1e957 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.562529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.562647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.563029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.563328] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.563553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.563612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.563863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.563964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.565149] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4362ce77-85ac-42be-8249-4cf8afc1e957',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.667603] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.667916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.670324] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.684314] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.685017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.685017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.685017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.685017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.685225] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.685225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.685348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.685376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.685448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.685530] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 is going to be updated. [ 649.718510] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.718911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.719106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.719483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.719712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.728939] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: IN_PROGRESS for 2s [ 650.068374] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.068471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.068789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.068789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.069300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.069300] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.069300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.069300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.069528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.069570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.069648] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 already deleted. [ 650.069740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.176488] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.192620] env[63014]: INFO networking_nsxv3.common.synchronization [None req-0e16550a-6dc3-4b57-ab64-0fd24da6fad0 None None] Enqueued Resource ID: 15572acf-547a-43f2-b8f4-f786e308b39b with Priority: HIGHEST for action port [ 650.193616] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15572acf-547a-43f2-b8f4-f786e308b39b with Priority: HIGHEST for action port [ 650.194513] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-15572acf-547a-43f2-b8f4-f786e308b39b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.194621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15572acf-547a-43f2-b8f4-f786e308b39b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.194659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15572acf-547a-43f2-b8f4-f786e308b39b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.195742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15572acf-547a-43f2-b8f4-f786e308b39b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.195826] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15572acf-547a-43f2-b8f4-f786e308b39b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.329769] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-25 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.330062] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.330062] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.330845] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.330845] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.330845] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.330845] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.331051] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.331621] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.331621] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.331621] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.331794] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.331839] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.331924] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.332037] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.332212] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.341809] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.343811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-800" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.343811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-800" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.343811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-800" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.343811] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.343811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.343811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.343811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.343811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.343811] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.343811] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.344311] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.344515] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.344707] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.344930] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.345151] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.353314] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.353314] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 650.353314] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.353314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.353314] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-0fefd178-2372-47eb-9071-b4240996ca44 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.353314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-0fefd178-2372-47eb-9071-b4240996ca44" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.353314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-0fefd178-2372-47eb-9071-b4240996ca44" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.353314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-0fefd178-2372-47eb-9071-b4240996ca44" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.353314] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fefd178-2372-47eb-9071-b4240996ca44',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.360440] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.366613] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 650.366613] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.366613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-800" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.366613] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-8cc705f2-4edf-41b4-9299-38cbadc112b9 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.366613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-8cc705f2-4edf-41b4-9299-38cbadc112b9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.366613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-8cc705f2-4edf-41b4-9299-38cbadc112b9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.366613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-8cc705f2-4edf-41b4-9299-38cbadc112b9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.366613] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc705f2-4edf-41b4-9299-38cbadc112b9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.679082] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.679296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.680244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.680545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.680708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.680854] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 650.700790] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15572acf-547a-43f2-b8f4-f786e308b39b [ 650.701046] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.701179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.701244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.701521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.701639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.701736] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15572acf-547a-43f2-b8f4-f786e308b39b already deleted. [ 650.701816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15572acf-547a-43f2-b8f4-f786e308b39b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.711149] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.711277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.711344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.712019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.712019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.721772] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 650.767620] env[63014]: INFO networking_nsxv3.common.synchronization [req-e3d0406f-6d0c-42a3-af1e-11e0836502ee req-06d3e0a4-8023-423c-a989-6944623e5ea7 service nova] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_rules [ 650.767942] env[63014]: INFO networking_nsxv3.common.synchronization [req-e3d0406f-6d0c-42a3-af1e-11e0836502ee req-06d3e0a4-8023-423c-a989-6944623e5ea7 service nova] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_members [ 650.768182] env[63014]: INFO networking_nsxv3.common.synchronization [req-e3d0406f-6d0c-42a3-af1e-11e0836502ee req-06d3e0a4-8023-423c-a989-6944623e5ea7 service nova] Enqueued Resource ID: 18e2ea98-76da-43b3-bab6-7673a7afb3bf with Priority: HIGHEST for action port [ 650.768496] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_rules [ 650.768726] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_members [ 650.768917] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e2ea98-76da-43b3-bab6-7673a7afb3bf with Priority: HIGHEST for action port [ 650.769652] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.769899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.770057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.770460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.770675] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.771600] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.771819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.771958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.772215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.772450] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.772659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.772842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.773672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.773672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.773672] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.778029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-18e2ea98-76da-43b3-bab6-7673a7afb3bf taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.778029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.778029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.778029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.778029] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e2ea98-76da-43b3-bab6-7673a7afb3bf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.838026] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df in Status: SUCCESS [ 650.838304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.841171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.841171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.841171] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.841171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.841171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.841171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.841171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.841171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.841171] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c3c5e73-32ea-4e2f-aecf-a8278a3549df',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.856797] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.857043] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.857277] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.857467] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.857617] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.857776] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 0fefd178-2372-47eb-9071-b4240996ca44 not found, creating... [ 650.858057] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.858251] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.858343] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.858564] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.858701] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.859099] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.859205] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.859304] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.859520] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.859660] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.859811] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 0fefd178-2372-47eb-9071-b4240996ca44 is going to be created. [ 650.870181] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.870690] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.870690] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.870783] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.870998] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.871144] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 8cc705f2-4edf-41b4-9299-38cbadc112b9 not found, creating... [ 650.871342] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.872037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.872037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.872037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.872037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.875932] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.877278] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.877278] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.877441] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.877619] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.877809] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 8cc705f2-4edf-41b4-9299-38cbadc112b9 is going to be created. [ 650.883643] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.884029] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.884138] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.886342] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.886342] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.886342] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-0fefd178-2372-47eb-9071-b4240996ca44" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.896939] env[63014]: INFO networking_nsxv3.common.synchronization [None req-5022deab-72d4-4167-9bd0-b013e0ef20ca None None] Enqueued Resource ID: d2c411a1-0b48-4c75-a996-89685050dc86 with Priority: HIGHEST for action port [ 650.898067] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c411a1-0b48-4c75-a996-89685050dc86 with Priority: HIGHEST for action port [ 650.898167] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2c411a1-0b48-4c75-a996-89685050dc86 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.898328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2c411a1-0b48-4c75-a996-89685050dc86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.898423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2c411a1-0b48-4c75-a996-89685050dc86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.898731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2c411a1-0b48-4c75-a996-89685050dc86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.898841] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2c411a1-0b48-4c75-a996-89685050dc86',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.904992] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.904992] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.904992] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.904992] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.904992] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.904992] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-8cc705f2-4edf-41b4-9299-38cbadc112b9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.278038] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.279174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.279267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.279419] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18e2ea98-76da-43b3-bab6-7673a7afb3bf with status ACTIVE [ 651.279591] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.279699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.279764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.279962] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.280064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.280236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.280343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.280381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.280534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.280613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.280795] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.280885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.280945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.283486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.286012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.286012] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18e2ea98-76da-43b3-bab6-7673a7afb3bf is going to be updated. [ 651.303988] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.304164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.304227] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.304442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.304581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.304781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.344497] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.344779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.344779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.344951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.345142] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.345358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.345358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.345438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.345521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.345609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.345753] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.349018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.349018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.349018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.349018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.349018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.349018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.349018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.349018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.349018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.349018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c3c5e73-32ea-4e2f-aecf-a8278a3549df',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.400731] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2c411a1-0b48-4c75-a996-89685050dc86 [ 651.400731] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.400907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.400937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.401189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.401279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.401389] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2c411a1-0b48-4c75-a996-89685050dc86 already deleted. [ 651.401472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2c411a1-0b48-4c75-a996-89685050dc86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.739591] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db4cd683-9721-46bf-9f15-99f7cf241691 in Status: SUCCESS [ 651.739591] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 deletion is rescheduled due to dependency. [ 651.739591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.787440] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.850754] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c3c5e73-32ea-4e2f-aecf-a8278a3549df: rpc.has_security_group_logging(os_id): False [ 651.869030] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.869625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.869625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.869625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.869625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.869816] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.869816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.869899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.870148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.870148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.870264] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.870355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.870413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.870556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.870632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.870833] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.871406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.871406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.871489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.871489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.871645] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df is going to be created. [ 651.943718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.943718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.943718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.943718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.943718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.955743] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df in Status: IN_PROGRESS for 2s [ 652.229660] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-0880fc16-d4b9-4491-8fab-077d44c5deb2 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 652.229851] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-0880fc16-d4b9-4491-8fab-077d44c5deb2 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 652.230022] env[63014]: INFO networking_nsxv3.common.synchronization [req-05e7e243-8e40-47fe-816c-eb22788baf06 req-0880fc16-d4b9-4491-8fab-077d44c5deb2 service nova] Enqueued Resource ID: 0fefd178-2372-47eb-9071-b4240996ca44 with Priority: HIGHEST for action port [ 652.230284] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 652.230432] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 652.230542] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fefd178-2372-47eb-9071-b4240996ca44 with Priority: HIGHEST for action port [ 652.231142] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.231292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.231507] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.231606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.231858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0fefd178-2372-47eb-9071-b4240996ca44 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.231943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0fefd178-2372-47eb-9071-b4240996ca44" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.231972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0fefd178-2372-47eb-9071-b4240996ca44" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.232178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0fefd178-2372-47eb-9071-b4240996ca44" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.232256] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0fefd178-2372-47eb-9071-b4240996ca44',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.261697] env[63014]: INFO networking_nsxv3.common.synchronization [req-42d1ab3a-9904-4f3e-bfb8-996ba2b85a8f req-7fe6d2cc-2306-4155-979d-2f8d362bdcda service nova] Enqueued Resource ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 with Priority: HIGHEST for action security_group_rules [ 652.261941] env[63014]: INFO networking_nsxv3.common.synchronization [req-42d1ab3a-9904-4f3e-bfb8-996ba2b85a8f req-7fe6d2cc-2306-4155-979d-2f8d362bdcda service nova] Enqueued Resource ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 with Priority: HIGHEST for action security_group_members [ 652.262136] env[63014]: INFO networking_nsxv3.common.synchronization [req-42d1ab3a-9904-4f3e-bfb8-996ba2b85a8f req-7fe6d2cc-2306-4155-979d-2f8d362bdcda service nova] Enqueued Resource ID: 8cc705f2-4edf-41b4-9299-38cbadc112b9 with Priority: HIGHEST for action port [ 652.263101] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 with Priority: HIGHEST for action security_group_rules [ 652.263259] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 with Priority: HIGHEST for action security_group_members [ 652.263397] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cc705f2-4edf-41b4-9299-38cbadc112b9 with Priority: HIGHEST for action port [ 652.263766] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4362ce77-85ac-42be-8249-4cf8afc1e957 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.263905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.263980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.264302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.266163] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4362ce77-85ac-42be-8249-4cf8afc1e957',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.266163] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4362ce77-85ac-42be-8249-4cf8afc1e957 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.266163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.266163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.266163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.266163] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.266163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.266163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.266460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.266460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.266460] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4362ce77-85ac-42be-8249-4cf8afc1e957',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.267586] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cc705f2-4edf-41b4-9299-38cbadc112b9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.267718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cc705f2-4edf-41b4-9299-38cbadc112b9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.267788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cc705f2-4edf-41b4-9299-38cbadc112b9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.267947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cc705f2-4edf-41b4-9299-38cbadc112b9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.268032] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cc705f2-4edf-41b4-9299-38cbadc112b9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.287790] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.287945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.288029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.288247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.288342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.288441] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 is going to be created. [ 652.313773] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.313916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.314287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.314519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.314680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.324473] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: UNINITIALIZED for 2s [ 652.405125] env[63014]: INFO networking_nsxv3.common.synchronization [req-17fd8c10-ac70-4304-98b3-b08310ae5521 req-a99d5536-3dee-43a3-89cc-0c497b0dffb5 tempest-ServerPasswordTestJSON-1317762635 tempest-ServerPasswordTestJSON-1317762635-project-member] Enqueued Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGHEST for action security_group_members [ 652.405125] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGHEST for action security_group_members [ 652.405125] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1262ce7-9d69-4ee4-9458-d12053088d94 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.405125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.405125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.405125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.405820] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.406281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.406538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.407015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.407387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.407694] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.464545] env[63014]: INFO networking_nsxv3.common.synchronization [None req-08c824b3-94e2-4e50-bdec-fdd5d48522b4 None None] Enqueued Resource ID: 82c7baba-89ff-4100-9af3-569ccb0a590a with Priority: HIGHEST for action port [ 652.465155] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c7baba-89ff-4100-9af3-569ccb0a590a with Priority: HIGHEST for action port [ 652.465492] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-82c7baba-89ff-4100-9af3-569ccb0a590a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.465623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82c7baba-89ff-4100-9af3-569ccb0a590a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.465689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82c7baba-89ff-4100-9af3-569ccb0a590a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.466068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82c7baba-89ff-4100-9af3-569ccb0a590a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.466113] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c7baba-89ff-4100-9af3-569ccb0a590a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.712994] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-430 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.713215] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.713342] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.713693] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.713968] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.717799] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.717930] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.718207] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.718361] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.718581] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.718706] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.718821] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.718969] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.719108] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 652.719261] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.719356] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.733796] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 652.734018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.734349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.734413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.734563] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.734681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.734782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.734980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.735141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.735258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.735801] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.735801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.735801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.735801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.736348] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.736502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.736593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.736770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.736879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.737142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.737676] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.738894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.739392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.740148] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.740289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.740362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.740535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.740623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.740718] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.741638] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0fefd178-2372-47eb-9071-b4240996ca44 with status ACTIVE [ 652.742239] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.742389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.742389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.742556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.743189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.743189] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.743189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.743189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.743189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.743407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.743407] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.743505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.743557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.743755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.743829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.743913] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0fefd178-2372-47eb-9071-b4240996ca44 is going to be updated. [ 652.746668] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.746668] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 652.746668] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.746668] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.746668] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-77b8bb92-f471-4f0b-83a5-036b71057f2d taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.747145] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-77b8bb92-f471-4f0b-83a5-036b71057f2d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.747145] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-77b8bb92-f471-4f0b-83a5-036b71057f2d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.747145] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-77b8bb92-f471-4f0b-83a5-036b71057f2d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.747320] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b8bb92-f471-4f0b-83a5-036b71057f2d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.770330] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4362ce77-85ac-42be-8249-4cf8afc1e957',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.771247] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4362ce77-85ac-42be-8249-4cf8afc1e957 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.771363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.775504] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8cc705f2-4edf-41b4-9299-38cbadc112b9 with status ACTIVE [ 652.775723] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.775851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.775915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.776131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.776217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.776390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.776482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.776541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.776686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.776758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.776931] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.777023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.777087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.777220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.777291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.777373] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8cc705f2-4edf-41b4-9299-38cbadc112b9 is going to be updated. [ 652.781900] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.782072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.782140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.782307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.782434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.782598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0fefd178-2372-47eb-9071-b4240996ca44" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.831513] env[63014]: INFO networking_nsxv3.common.synchronization [None req-3793e8dd-0d55-49b7-beb6-848ef4160050 None None] Enqueued Resource ID: 0479bb17-50ec-4900-a53c-cf616f8b22d7 with Priority: HIGHEST for action port [ 652.832076] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0479bb17-50ec-4900-a53c-cf616f8b22d7 with Priority: HIGHEST for action port [ 652.832384] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0479bb17-50ec-4900-a53c-cf616f8b22d7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.833063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0479bb17-50ec-4900-a53c-cf616f8b22d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.833140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0479bb17-50ec-4900-a53c-cf616f8b22d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.833882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0479bb17-50ec-4900-a53c-cf616f8b22d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.833882] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0479bb17-50ec-4900-a53c-cf616f8b22d7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.837718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.837718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.837824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.838513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.839049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.839259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cc705f2-4edf-41b4-9299-38cbadc112b9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.912762] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.912924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.913032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.913318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.913416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.913641] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.913763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.913831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.913991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.914084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.914174] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1262ce7-9d69-4ee4-9458-d12053088d94 already deleted. [ 652.914255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.968696] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82c7baba-89ff-4100-9af3-569ccb0a590a [ 652.968696] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.968696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.968696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.972381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.972457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.972578] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82c7baba-89ff-4100-9af3-569ccb0a590a already deleted. [ 652.972660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82c7baba-89ff-4100-9af3-569ccb0a590a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.245948] env[63014]: INFO networking_nsxv3.common.synchronization [None req-8a4f930c-312b-4ccd-af7c-e2ce74d03585 tempest-ServerActionsV293TestJSON-1713986573 tempest-ServerActionsV293TestJSON-1713986573-project-member] Enqueued Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_rules [ 653.246531] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_rules [ 653.246828] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.247155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.247155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.247652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.248420] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.248929] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.250507] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef90f51b-2d80-447d-910c-f5ca10a227fb: rpc.has_security_group_logging(os_id): False [ 653.253989] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.254119] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.254197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.254454] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.254610] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.254762] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 77b8bb92-f471-4f0b-83a5-036b71057f2d not found, creating... [ 653.255049] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.255212] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.255329] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.255563] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.257027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.257027] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.257027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.257027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.257027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.257027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.257027] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 77b8bb92-f471-4f0b-83a5-036b71057f2d is going to be created. [ 653.272759] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4362ce77-85ac-42be-8249-4cf8afc1e957',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.275340] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.275508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.275544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.278495] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.278495] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.278495] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.278495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.278913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.278913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.278913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.278913] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be created. [ 653.279408] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.279579] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.279703] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.279924] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.280157] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.280373] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-77b8bb92-f471-4f0b-83a5-036b71057f2d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.335189] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0479bb17-50ec-4900-a53c-cf616f8b22d7 [ 653.335291] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.335420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.335608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.335941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.336121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.336225] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0479bb17-50ec-4900-a53c-cf616f8b22d7 already deleted. [ 653.339016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0479bb17-50ec-4900-a53c-cf616f8b22d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.342044] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.342174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.342242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.342434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.342611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.352507] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 653.490136] env[63014]: INFO networking_nsxv3.common.synchronization [None req-81e269c2-a4a0-4669-9230-1162fd610e6f tempest-ServerActionsV293TestJSON-1713986573 tempest-ServerActionsV293TestJSON-1713986573-project-member] Enqueued Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_rules [ 653.491345] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_rules [ 653.491711] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.494084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.751775] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.770695] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.770853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.770925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.771125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.771231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.771319] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 already deleted. [ 653.771435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.771983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.772506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.772506] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.777825] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.777825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.777825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.777825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.777825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.777825] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 is going to be created. [ 653.797325] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.797325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.797325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.797325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.797325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.805745] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 in Status: UNINITIALIZED for 2s [ 653.972360] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df in Status: SUCCESS [ 653.972579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.230227] env[63014]: INFO networking_nsxv3.common.synchronization [req-17fd8c10-ac70-4304-98b3-b08310ae5521 req-6fe1181a-d9a9-4f83-adc4-8d532f2934e5 service nova] Enqueued Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGHEST for action security_group_rules [ 654.230227] env[63014]: INFO networking_nsxv3.common.synchronization [req-17fd8c10-ac70-4304-98b3-b08310ae5521 req-6fe1181a-d9a9-4f83-adc4-8d532f2934e5 service nova] Enqueued Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGHEST for action security_group_members [ 654.230227] env[63014]: INFO networking_nsxv3.common.synchronization [req-17fd8c10-ac70-4304-98b3-b08310ae5521 req-6fe1181a-d9a9-4f83-adc4-8d532f2934e5 service nova] Enqueued Resource ID: 77b8bb92-f471-4f0b-83a5-036b71057f2d with Priority: HIGHEST for action port [ 654.230751] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGHEST for action security_group_rules [ 654.230925] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGHEST for action security_group_members [ 654.231056] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77b8bb92-f471-4f0b-83a5-036b71057f2d with Priority: HIGHEST for action port [ 654.231403] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1262ce7-9d69-4ee4-9458-d12053088d94 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.231544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.231671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.232056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.232056] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.233174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1262ce7-9d69-4ee4-9458-d12053088d94 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.233346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.233499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.233933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.233933] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.234050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.234150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.234398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.234398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.234536] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.235305] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-77b8bb92-f471-4f0b-83a5-036b71057f2d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.235413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77b8bb92-f471-4f0b-83a5-036b71057f2d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.235496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77b8bb92-f471-4f0b-83a5-036b71057f2d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.235843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77b8bb92-f471-4f0b-83a5-036b71057f2d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.235843] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77b8bb92-f471-4f0b-83a5-036b71057f2d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.254338] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.254589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.254709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.254959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.255504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.255504] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 654.305856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.305979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.305979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.306182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.306274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.306402] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 already deleted. [ 654.306446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.307437] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.307437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.307531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.307624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.307751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.318620] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 654.335629] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: SUCCESS [ 654.335939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.336067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.336302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.336511] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.336621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.336677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.336848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.337049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.337049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.337215] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.711782] env[63014]: INFO networking_nsxv3.common.synchronization [None req-373b982c-8c97-4848-bf70-d517c858d32e None None] Enqueued Resource ID: 473a5b90-68a6-45ac-9afe-7265ba8a6166 with Priority: HIGHEST for action port [ 654.713652] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 473a5b90-68a6-45ac-9afe-7265ba8a6166 with Priority: HIGHEST for action port [ 654.713652] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-473a5b90-68a6-45ac-9afe-7265ba8a6166 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.713954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-473a5b90-68a6-45ac-9afe-7265ba8a6166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.713954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-473a5b90-68a6-45ac-9afe-7265ba8a6166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.714877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-473a5b90-68a6-45ac-9afe-7265ba8a6166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.714877] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('473a5b90-68a6-45ac-9afe-7265ba8a6166',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.739188] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1262ce7-9d69-4ee4-9458-d12053088d94 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.739188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.739188] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.740268] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77b8bb92-f471-4f0b-83a5-036b71057f2d with status ACTIVE [ 654.740741] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.740849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.740942] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.741176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.741302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.741549] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.741705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.742080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.742298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.742412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.742638] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.742765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.742847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.743017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.743127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.743221] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77b8bb92-f471-4f0b-83a5-036b71057f2d is going to be updated. [ 654.766995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.766995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.766995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.766995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.766995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.766995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77b8bb92-f471-4f0b-83a5-036b71057f2d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.840329] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.222158] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 473a5b90-68a6-45ac-9afe-7265ba8a6166 [ 655.222158] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.222158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.222158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.222158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.222158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.222158] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:473a5b90-68a6-45ac-9afe-7265ba8a6166 already deleted. [ 655.222158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-473a5b90-68a6-45ac-9afe-7265ba8a6166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.247428] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.342833] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a204f6f-e771-4e85-aa7c-c93c90225b83: rpc.has_security_group_logging(os_id): False [ 655.363325] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.363528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.363765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.363870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.363942] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.365171] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.365171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.365171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.365171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.365171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.365171] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 is going to be created. [ 655.366622] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 655.366832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.367616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.367616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.367689] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.423025] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.423025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.423025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.423025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.423025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.435993] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: IN_PROGRESS for 2s [ 655.629309] env[63014]: INFO networking_nsxv3.common.synchronization [req-b1a79c57-e7d5-4371-8b17-a0505a648cc5 req-eb2fa34a-dea0-4fd2-b815-81e773e1694d tempest-ServerExternalEventsTest-205549313 tempest-ServerExternalEventsTest-205549313-project-member] Enqueued Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGHEST for action security_group_members [ 655.629969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGHEST for action security_group_members [ 655.630364] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c90ff-575c-404c-9432-915836e29303 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.630492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.630560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.630813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.630974] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.631147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.631209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.631370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.631457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.631574] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.752516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.752516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.752516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.752827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.752827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.752827] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1262ce7-9d69-4ee4-9458-d12053088d94 is going to be created. [ 655.776078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.776249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.776316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.776528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.776690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.786239] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1262ce7-9d69-4ee4-9458-d12053088d94 in Status: UNINITIALIZED for 2s [ 655.814589] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 in Status: SUCCESS [ 655.815620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.816098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.816619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.816919] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.817373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.817562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.818525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.818759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.818923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.819181] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4362ce77-85ac-42be-8249-4cf8afc1e957',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.871616] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.871784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.135638] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.135638] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.135638] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c90ff-575c-404c-9432-915836e29303 already deleted. [ 656.135638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.321970] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4362ce77-85ac-42be-8249-4cf8afc1e957 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.325043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.325043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.325043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.325043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.325043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.325043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.325043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.325043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.325043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.325043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4362ce77-85ac-42be-8249-4cf8afc1e957 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.328498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.328498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.328498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.328498] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.328498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.328498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.328498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.328498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.328498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.328498] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4362ce77-85ac-42be-8249-4cf8afc1e957',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.330177] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 656.330511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.331158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.331460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.331770] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.332278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.332456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.332714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.332905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.333161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.333411] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.339302] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.339302] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.339302] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.339302] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.339302] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.339302] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.339673] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.340028] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.340303] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.340624] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.340845] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.341065] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.341278] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.341571] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 656.341826] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.342187] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.367105] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.367270] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 656.367427] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.367619] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.367969] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-b34f8c19-0b33-4185-9ab1-019c400919ea taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.368773] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-b34f8c19-0b33-4185-9ab1-019c400919ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.368933] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-b34f8c19-0b33-4185-9ab1-019c400919ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.369338] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-b34f8c19-0b33-4185-9ab1-019c400919ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.369482] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b34f8c19-0b33-4185-9ab1-019c400919ea',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.831657] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4362ce77-85ac-42be-8249-4cf8afc1e957: rpc.has_security_group_logging(os_id): False [ 656.838524] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.838701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.838779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.839040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.839240] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.839350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.839412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.839591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.839694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.839874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.839949] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.840046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.840216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.840256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.840402] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.840491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.840561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.840701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.840793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.840874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.840961] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.849784] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.850086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.850156] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.850375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.850493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.850899] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.850899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.851079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.852809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.852809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.852809] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.852809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.852809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.852809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.852809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.853220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.853220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.853220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.853220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.853396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.853396] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 is going to be created. [ 656.874217] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.874447] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.874614] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.874876] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.875045] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.875209] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port b34f8c19-0b33-4185-9ab1-019c400919ea not found, creating... [ 656.877186] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.880129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.880129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.880129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.880129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.880129] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.880129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.880129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.880129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.880129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.880129] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: b34f8c19-0b33-4185-9ab1-019c400919ea is going to be created. [ 656.903724] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.903950] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.904108] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.904396] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.904657] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.904925] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-b34f8c19-0b33-4185-9ab1-019c400919ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.916377] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.916553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.916606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.916798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.916990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.934328] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 in Status: IN_PROGRESS for 2s [ 657.346679] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef90f51b-2d80-447d-910c-f5ca10a227fb: rpc.has_security_group_logging(os_id): False [ 657.368022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.368022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.368022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.368022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.368683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.368683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.368683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.368683] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.368683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.368683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.368954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.368954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.369367] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 657.422637] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.422861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.423085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.423311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.423539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.439220] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 657.449441] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: SUCCESS [ 657.449796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.804935] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1262ce7-9d69-4ee4-9458-d12053088d94 in Status: SUCCESS [ 657.805266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.805374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.805854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.806484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.806484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.806484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.806484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.806678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.806678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.806737] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.928870] env[63014]: INFO networking_nsxv3.common.synchronization [req-b1a79c57-e7d5-4371-8b17-a0505a648cc5 req-ab5de0ad-2ee1-44bf-bf35-934c09ac5d67 service nova] Enqueued Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGHEST for action security_group_rules [ 657.929231] env[63014]: INFO networking_nsxv3.common.synchronization [req-b1a79c57-e7d5-4371-8b17-a0505a648cc5 req-ab5de0ad-2ee1-44bf-bf35-934c09ac5d67 service nova] Enqueued Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGHEST for action security_group_members [ 657.929304] env[63014]: INFO networking_nsxv3.common.synchronization [req-b1a79c57-e7d5-4371-8b17-a0505a648cc5 req-ab5de0ad-2ee1-44bf-bf35-934c09ac5d67 service nova] Enqueued Resource ID: b34f8c19-0b33-4185-9ab1-019c400919ea with Priority: HIGHEST for action port [ 657.929596] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGHEST for action security_group_rules [ 657.929735] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGHEST for action security_group_members [ 657.929825] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b34f8c19-0b33-4185-9ab1-019c400919ea with Priority: HIGHEST for action port [ 657.935092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c90ff-575c-404c-9432-915836e29303 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.935092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.935092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.935092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.935092] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.936518] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c90ff-575c-404c-9432-915836e29303 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.936518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.936518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.936860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.937081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.937437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.937437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.937821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.937907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.940028] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.940028] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-b34f8c19-0b33-4185-9ab1-019c400919ea taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.940028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b34f8c19-0b33-4185-9ab1-019c400919ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.940028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b34f8c19-0b33-4185-9ab1-019c400919ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.940028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b34f8c19-0b33-4185-9ab1-019c400919ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.940028] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b34f8c19-0b33-4185-9ab1-019c400919ea',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.145883] env[63014]: INFO networking_nsxv3.common.synchronization [req-2e278f51-0185-4dd7-a164-154808e84942 req-d5fe0d03-4d91-48fd-9863-a54036f7ad48 tempest-ServersTestManualDisk-740044999 tempest-ServersTestManualDisk-740044999-project-member] Enqueued Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_members [ 658.146472] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_members [ 658.146912] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.148910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.148910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.148910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.149088] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.149088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.149718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.149718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.149718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.149718] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.309491] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1262ce7-9d69-4ee4-9458-d12053088d94 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.309620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.309692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.310202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.310202] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.310321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.310321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.310476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.310610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.310734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.311405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1262ce7-9d69-4ee4-9458-d12053088d94 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.311405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.311405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.311839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.312528] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.312777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.312777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.312893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.312978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.314222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.314222] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.450054] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c90ff-575c-404c-9432-915836e29303 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.450054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.450054] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.450054] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b34f8c19-0b33-4185-9ab1-019c400919ea with status ACTIVE [ 658.450054] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.450054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.450054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.450054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.450054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.450054] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.450054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.450054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.450054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.450829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.451758] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.452153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.452469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.452744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.452935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.453258] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b34f8c19-0b33-4185-9ab1-019c400919ea is going to be updated. [ 658.475155] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.475335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.475402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.475903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.475903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.476083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b34f8c19-0b33-4185-9ab1-019c400919ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.649041] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-795 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.649291] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-795" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.650319] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-795" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.650319] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-795" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.650861] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.651028] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.651211] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.651417] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.651578] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.651886] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.651941] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.652034] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.652144] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.652255] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 658.652362] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.652497] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.653952] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.656083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.656199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.656414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.656559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.656766] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.656857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.656928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.657137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.657205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.657247] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 already deleted. [ 658.657323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.674694] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.674936] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 658.675123] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.675369] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-795" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.675683] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-5420a0ce-b6fd-4c49-945c-70952997703b taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.675864] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-5420a0ce-b6fd-4c49-945c-70952997703b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.675991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-5420a0ce-b6fd-4c49-945c-70952997703b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.676325] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-5420a0ce-b6fd-4c49-945c-70952997703b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.676460] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5420a0ce-b6fd-4c49-945c-70952997703b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.817883] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a1262ce7-9d69-4ee4-9458-d12053088d94: rpc.has_security_group_logging(os_id): False [ 658.833985] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.834224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.834275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.834505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.834554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.834746] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.834826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.834876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.835023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.835102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.835287] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.835395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.835443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.835574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.835651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.835842] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.835947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.836054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.836228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.836310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.836398] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1262ce7-9d69-4ee4-9458-d12053088d94 is going to be created. [ 658.885606] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.885781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.885845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.886116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.886307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.897982] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1262ce7-9d69-4ee4-9458-d12053088d94 in Status: IN_PROGRESS for 2s [ 658.955375] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 in Status: SUCCESS [ 658.955666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.957060] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.179011] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.179365] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.179484] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.179784] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.179953] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.180231] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 5420a0ce-b6fd-4c49-945c-70952997703b not found, creating... [ 659.180558] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.180893] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.181044] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.181289] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.181435] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.181793] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.181968] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.182100] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.182354] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.182499] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.182662] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 5420a0ce-b6fd-4c49-945c-70952997703b is going to be created. [ 659.204204] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.204428] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.204626] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.204969] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.205561] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.206308] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-5420a0ce-b6fd-4c49-945c-70952997703b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.453911] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 659.453911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.453911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.453911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.453911] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.460828] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.460828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.460828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.460828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.460828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.460828] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c90ff-575c-404c-9432-915836e29303 is going to be created. [ 659.485012] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.485012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.485012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.485012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.485012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.496152] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c90ff-575c-404c-9432-915836e29303 in Status: UNINITIALIZED for 2s [ 659.959922] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.960301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.960301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.961058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.961058] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.961058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.961058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.961058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.961245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.961245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.961309] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.963838] env[63014]: INFO networking_nsxv3.common.synchronization [req-2e278f51-0185-4dd7-a164-154808e84942 req-ebd1d31b-c0bd-4177-8a80-287e1346f99f service nova] Enqueued Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_rules [ 659.964735] env[63014]: INFO networking_nsxv3.common.synchronization [req-2e278f51-0185-4dd7-a164-154808e84942 req-ebd1d31b-c0bd-4177-8a80-287e1346f99f service nova] Enqueued Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_members [ 659.964735] env[63014]: INFO networking_nsxv3.common.synchronization [req-2e278f51-0185-4dd7-a164-154808e84942 req-ebd1d31b-c0bd-4177-8a80-287e1346f99f service nova] Enqueued Resource ID: 5420a0ce-b6fd-4c49-945c-70952997703b with Priority: HIGHEST for action port [ 659.966042] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_rules [ 659.966268] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_members [ 659.966933] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5420a0ce-b6fd-4c49-945c-70952997703b with Priority: HIGHEST for action port [ 659.967328] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.967421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.967452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.967618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.967723] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.970068] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.973068] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.973068] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.973068] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-5420a0ce-b6fd-4c49-945c-70952997703b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5420a0ce-b6fd-4c49-945c-70952997703b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5420a0ce-b6fd-4c49-945c-70952997703b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.973068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5420a0ce-b6fd-4c49-945c-70952997703b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.973068] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5420a0ce-b6fd-4c49-945c-70952997703b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.466880] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.467148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.467224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.467475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.467618] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.467815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.467923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.468058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.468155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.468242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.468408] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.468496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.468552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.468688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.468825] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.468911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.469121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.469121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.469181] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.469255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.469342] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.473342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.474533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.474533] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.474533] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5420a0ce-b6fd-4c49-945c-70952997703b with status ACTIVE [ 660.475054] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.475054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.475054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.475054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.475054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.475412] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.475412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.475412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.475568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.475568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.475771] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.475880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.475880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.481025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.481025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.481025] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5420a0ce-b6fd-4c49-945c-70952997703b is going to be updated. [ 660.666198] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.666333] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.666418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.666640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.666777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.666937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5420a0ce-b6fd-4c49-945c-70952997703b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.908924] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a1262ce7-9d69-4ee4-9458-d12053088d94 in Status: SUCCESS [ 660.909193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.974520] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef90f51b-2d80-447d-910c-f5ca10a227fb: rpc.has_security_group_logging(os_id): False [ 660.990539] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.990676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.990750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.990975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.991152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.991375] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.991447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.991447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.991595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.991725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.991915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.991990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.992038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.992179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.992397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.992451] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.992503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.992558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.992696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.992759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.992843] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 661.050859] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.051056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.051056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.051280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.051468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.067989] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 661.147945] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.506478] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c90ff-575c-404c-9432-915836e29303 in Status: SUCCESS [ 661.507195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.507195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.507195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.507439] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.507439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.507552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.507640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.507711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.507796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.507882] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.651253] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.651401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.651469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.651691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.651777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.651878] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 is going to be created. [ 661.679983] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.680261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.680402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.680781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.681392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.695493] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 in Status: UNINITIALIZED for 2s [ 662.013871] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c90ff-575c-404c-9432-915836e29303 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.014378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.014378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.015361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.015670] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.015799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.016052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.016275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.016364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.016453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.016641] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c90ff-575c-404c-9432-915836e29303 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.016739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.016802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.017019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.017227] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.017312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.017374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.017536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.017616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.017688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.017918] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.522725] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a5c90ff-575c-404c-9432-915836e29303: rpc.has_security_group_logging(os_id): False [ 662.539896] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.540820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.540820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.540820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.540820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.540820] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.541064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.541094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.541274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.541354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.541584] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.541720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.541817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.541932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.542017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.542585] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.543329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.544283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.544283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.544283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.544470] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c90ff-575c-404c-9432-915836e29303 is going to be created. [ 662.597344] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.597981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.598134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.599422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.599679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.610730] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c90ff-575c-404c-9432-915836e29303 in Status: IN_PROGRESS for 2s [ 663.079655] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 663.079655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.706116] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 in Status: SUCCESS [ 663.706511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.707291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.707537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.707736] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.707835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.707904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.708099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.708177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.708599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.708599] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.212553] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.622756] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c90ff-575c-404c-9432-915836e29303 in Status: SUCCESS [ 664.623173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.715061] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d46ba6da-2ed2-4606-ad13-bb35d32bcb52: rpc.has_security_group_logging(os_id): False [ 664.731188] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.731404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.731404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.731697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.731858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.732145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.732323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.732323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.732488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.732641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.732641] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 is going to be created. [ 664.789948] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.789948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.789948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.789948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.789948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.800982] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 in Status: IN_PROGRESS for 2s [ 664.968537] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 664.968881] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 666.816061] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 in Status: SUCCESS [ 666.816789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.339475] env[63014]: INFO networking_nsxv3.common.synchronization [req-f4a29db4-be26-45cf-a4d9-88d1e66b3b46 req-45ef7c6f-5161-40fb-9f52-92c169993b5b tempest-ServerAddressesNegativeTestJSON-1906775353 tempest-ServerAddressesNegativeTestJSON-1906775353-project-member] Enqueued Resource ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 with Priority: HIGHEST for action security_group_members [ 668.339984] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 with Priority: HIGHEST for action security_group_members [ 668.340318] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4362ce77-85ac-42be-8249-4cf8afc1e957 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.340471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.340561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.340824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.340995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.341925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.341925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.342135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.342232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.342327] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4362ce77-85ac-42be-8249-4cf8afc1e957',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.521114] env[63014]: INFO networking_nsxv3.common.synchronization [req-671fe566-9c7e-43cb-956f-72fd0135b323 req-2764a1bb-9908-43a0-870a-97a469f0b9b9 tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 668.521114] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 668.521114] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.521114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.521114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.521114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.521952] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.522114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.522183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.522363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.522450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.522557] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.658792] env[63014]: INFO networking_nsxv3.common.synchronization [req-af152c17-5758-4be8-bd74-2be1df7fb2f1 req-8fa123c6-5673-4eb8-83f8-9df921443fb6 tempest-ServerPasswordTestJSON-1317762635 tempest-ServerPasswordTestJSON-1317762635-project-member] Enqueued Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGHEST for action security_group_members [ 668.659220] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGHEST for action security_group_members [ 668.659569] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a1262ce7-9d69-4ee4-9458-d12053088d94 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.659569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.659569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.659731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.659777] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.659931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.659931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.660090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.660185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.660713] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.851021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.851021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.851021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.851021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.851021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.851021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.851021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.851021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.852841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.852969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.853092] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 is going to be updated. [ 668.885917] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.886086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.886176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.886402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.886630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.895013] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 in Status: IN_PROGRESS for 2s [ 668.918338] env[63014]: INFO networking_nsxv3.common.synchronization [req-671fe566-9c7e-43cb-956f-72fd0135b323 req-d4696dec-a9f6-4e76-b8c3-2a7bdc9911dc tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 668.918958] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 668.919269] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.919372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.962833] env[63014]: INFO networking_nsxv3.common.synchronization [req-b7489f0d-2ccd-420d-9ac2-a13d4cf8f80d req-e6c7fc11-714d-48af-b194-17216c70c1b2 tempest-ServersAdminNegativeTestJSON-817582727 tempest-ServersAdminNegativeTestJSON-817582727-project-member] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 668.962833] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 668.963662] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.963662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.963662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.963662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.964806] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.964806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.964806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.964806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.964806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.964806] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.024877] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.163029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.163178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.163246] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.163479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.163570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.163822] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.163936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.163978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.165029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.165029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.165029] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1262ce7-9d69-4ee4-9458-d12053088d94 is going to be updated. [ 669.207785] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.208303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.208303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.208303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.208498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.220231] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1262ce7-9d69-4ee4-9458-d12053088d94 in Status: IN_PROGRESS for 2s [ 669.399539] env[63014]: INFO networking_nsxv3.common.synchronization [req-671fe566-9c7e-43cb-956f-72fd0135b323 req-effdc8a5-cfe1-4047-b614-76d483922ee3 tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 669.401717] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 669.401717] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.402016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.472441] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.472628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.472666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.472878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.472972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.473185] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.473283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.473343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.473490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.473565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.473650] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb already deleted. [ 669.473734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.527352] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.794700] env[63014]: INFO networking_nsxv3.common.synchronization [req-1804809f-ca17-4544-a503-5f77957babe1 req-ad3a93c9-6caf-441f-920b-096ede1ca62a tempest-FloatingIPsAssociationNegativeTestJSON-168841279 tempest-FloatingIPsAssociationNegativeTestJSON-168841279-project-member] Enqueued Resource ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df with Priority: HIGHEST for action security_group_members [ 669.795509] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df with Priority: HIGHEST for action security_group_members [ 669.795819] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.795943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.796043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.796256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.796699] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.796810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.796870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.797115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.797145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.797242] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c3c5e73-32ea-4e2f-aecf-a8278a3549df',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.829943] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.830187] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.830333] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.830597] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.830834] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.830983] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.831111] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.831316] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.831458] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.831661] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.831792] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.831919] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.832050] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.832201] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 669.832316] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.832456] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.852200] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.852401] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 669.852512] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.852688] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.853022] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.853198] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.853391] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.853638] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.853800] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b28ec97-5b49-4777-9e39-1ad810ac5f4a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.030448] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.030601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.030671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.030875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.030970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.031493] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 670.064715] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.064715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.064715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.064715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.064715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.072018] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 670.299541] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.299704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.299775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.300133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.300133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.300302] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.300398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.300459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.300612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.300690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.300781] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df is going to be updated. [ 670.339023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.339023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.339023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.339023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.339023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.346748] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df in Status: IN_PROGRESS for 2s [ 670.360735] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.360939] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.361536] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.361536] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.361663] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.362121] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 6b28ec97-5b49-4777-9e39-1ad810ac5f4a not found, creating... [ 670.362461] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.362889] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.362889] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.363298] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.363483] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.363903] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.364624] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.364624] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.364624] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.364624] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.364778] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 6b28ec97-5b49-4777-9e39-1ad810ac5f4a is going to be created. [ 670.401012] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.401363] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.401363] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.401796] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.401902] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.402173] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.614451] env[63014]: INFO networking_nsxv3.common.synchronization [None req-325d3746-0568-4dac-b1ac-b9c7f95a7bb2 None None] Enqueued Resource ID: 50d3210b-4517-440d-a9a9-b76ed06a693f with Priority: HIGHEST for action port [ 670.614540] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50d3210b-4517-440d-a9a9-b76ed06a693f with Priority: HIGHEST for action port [ 670.615157] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-50d3210b-4517-440d-a9a9-b76ed06a693f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.615301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50d3210b-4517-440d-a9a9-b76ed06a693f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.615376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50d3210b-4517-440d-a9a9-b76ed06a693f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.615878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50d3210b-4517-440d-a9a9-b76ed06a693f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.615878] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50d3210b-4517-440d-a9a9-b76ed06a693f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.904200] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 in Status: SUCCESS [ 670.904384] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4362ce77-85ac-42be-8249-4cf8afc1e957 deletion is rescheduled due to dependency. [ 670.904500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4362ce77-85ac-42be-8249-4cf8afc1e957" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.118028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50d3210b-4517-440d-a9a9-b76ed06a693f [ 671.118284] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.118421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.118499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.118711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.118804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.118901] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50d3210b-4517-440d-a9a9-b76ed06a693f already deleted. [ 671.118983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50d3210b-4517-440d-a9a9-b76ed06a693f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.126743] env[63014]: INFO networking_nsxv3.common.synchronization [req-47223ea1-3155-4a63-a71e-1f1699b9ae1f req-c971efc2-933d-4fa6-afb6-cb86fce004b1 tempest-ImagesOneServerNegativeTestJSON-1556540069 tempest-ImagesOneServerNegativeTestJSON-1556540069-project-member] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 671.126990] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 671.128406] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.128545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.128617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.129102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.129206] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.129474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.129474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.129474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.129558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.131123] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.230873] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a1262ce7-9d69-4ee4-9458-d12053088d94 in Status: SUCCESS [ 671.231296] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a1262ce7-9d69-4ee4-9458-d12053088d94 deletion is rescheduled due to dependency. [ 671.234575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.418636] env[63014]: INFO networking_nsxv3.common.synchronization [req-b7489f0d-2ccd-420d-9ac2-a13d4cf8f80d req-ada32bbe-a414-46a3-8bef-8ec5b7fe0877 service nova] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_rules [ 671.419056] env[63014]: INFO networking_nsxv3.common.synchronization [req-b7489f0d-2ccd-420d-9ac2-a13d4cf8f80d req-ada32bbe-a414-46a3-8bef-8ec5b7fe0877 service nova] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 671.419056] env[63014]: INFO networking_nsxv3.common.synchronization [req-b7489f0d-2ccd-420d-9ac2-a13d4cf8f80d req-ada32bbe-a414-46a3-8bef-8ec5b7fe0877 service nova] Enqueued Resource ID: 6b28ec97-5b49-4777-9e39-1ad810ac5f4a with Priority: HIGHEST for action port [ 671.421695] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_rules [ 671.421695] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 671.421695] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b28ec97-5b49-4777-9e39-1ad810ac5f4a with Priority: HIGHEST for action port [ 671.421695] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.421695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.422054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.424085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.424085] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.424589] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.424742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.425797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.425797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.425797] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.425797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.425797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.425797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.425797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.425797] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.426528] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.426644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.426712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.430051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.430051] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b28ec97-5b49-4777-9e39-1ad810ac5f4a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.638319] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.639973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.639973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.639973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.639973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.639973] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.639973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.639973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.639973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.639973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.639973] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 671.666329] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.666492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.666533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.671342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.671342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.680406] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 671.931489] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.931489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.931489] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.931489] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b28ec97-5b49-4777-9e39-1ad810ac5f4a with status ACTIVE [ 671.935273] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.935417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.935493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.935730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.935829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.936036] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.936139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.936194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.936346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.936418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.936598] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.936675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.936738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.936879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.936951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.937783] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b28ec97-5b49-4777-9e39-1ad810ac5f4a is going to be updated. [ 671.958293] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.958882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.958997] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.959658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.959816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.960028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b28ec97-5b49-4777-9e39-1ad810ac5f4a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.085207] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 672.085574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.085851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.086477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.086477] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.086675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.086855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.087093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.087292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.087558] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.356409] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df in Status: SUCCESS [ 672.356585] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c3c5e73-32ea-4e2f-aecf-a8278a3549df deletion is rescheduled due to dependency. [ 672.356702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c3c5e73-32ea-4e2f-aecf-a8278a3549df" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.440123] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.592347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.592347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.592347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.592347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.592347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.592347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.592347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.592347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.592347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.592347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.592347] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 672.624710] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.624875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.624948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.625174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.625307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.635418] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 672.806440] env[63014]: INFO networking_nsxv3.common.synchronization [None req-e360c279-6d97-41ed-a15a-6d3aa064e0db None None] Enqueued Resource ID: 04350770-3bc8-4243-a28e-6cd93d0b05d7 with Priority: HIGHEST for action port [ 672.806708] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04350770-3bc8-4243-a28e-6cd93d0b05d7 with Priority: HIGHEST for action port [ 672.807308] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-04350770-3bc8-4243-a28e-6cd93d0b05d7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.807433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04350770-3bc8-4243-a28e-6cd93d0b05d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.807499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04350770-3bc8-4243-a28e-6cd93d0b05d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.807746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04350770-3bc8-4243-a28e-6cd93d0b05d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.807827] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04350770-3bc8-4243-a28e-6cd93d0b05d7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.945093] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.945093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.945093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.945093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.945093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.945093] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb is going to be created. [ 672.966708] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.966895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.966957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.967145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.967348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.979188] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: UNINITIALIZED for 2s [ 673.310496] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04350770-3bc8-4243-a28e-6cd93d0b05d7 [ 673.311081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.311081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.311081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.311234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.311262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.311354] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04350770-3bc8-4243-a28e-6cd93d0b05d7 already deleted. [ 673.311437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04350770-3bc8-4243-a28e-6cd93d0b05d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.690814] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 673.691121] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 deletion is rescheduled due to dependency. [ 673.691121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.368711] env[63014]: INFO networking_nsxv3.common.synchronization [req-63b5e33a-1ad3-41a5-acef-26a3096303ba req-f7366010-b24c-4296-9c8c-91f23775295e tempest-ServerExternalEventsTest-205549313 tempest-ServerExternalEventsTest-205549313-project-member] Enqueued Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGHEST for action security_group_members [ 674.369474] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGHEST for action security_group_members [ 674.371044] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c90ff-575c-404c-9432-915836e29303 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.371237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.371353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.371718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.371914] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.372084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.372128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.372288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.372376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.372472] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.644544] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 674.644693] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb deletion is rescheduled due to dependency. [ 674.644841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.645039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.645268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.645486] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.645680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.645680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.645821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.645902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.645997] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.875255] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.876636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.876636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.876636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.876636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.876636] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.876636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.876636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.876636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.876636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.876636] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c90ff-575c-404c-9432-915836e29303 is going to be updated. [ 674.904384] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.904533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.904589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.904860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.905155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.913129] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c90ff-575c-404c-9432-915836e29303 in Status: IN_PROGRESS for 2s [ 674.991897] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: SUCCESS [ 674.991897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.991897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.991897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.991897] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.991897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.991897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.991897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.991897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.991897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.991897] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.999695] env[63014]: INFO networking_nsxv3.common.synchronization [req-fb0f0a25-b8fe-4bd2-a585-3ee9a1255d90 req-3f6ab925-82fe-49f6-9bc8-416017bc0448 tempest-ServersAdminTestJSON-1268263957 tempest-ServersAdminTestJSON-1268263957-project-member] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 675.000071] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 675.000646] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.000767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.001182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.001182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.001340] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.001409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.001409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.001564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.001950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.002077] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.032485] env[63014]: INFO networking_nsxv3.common.synchronization [req-1e798223-0cf3-4fa1-98af-f7b8db4177aa req-bfdf602c-2fe1-44f6-82a4-740fe4c4ff83 tempest-FloatingIPsAssociationTestJSON-1182186772 tempest-FloatingIPsAssociationTestJSON-1182186772-project-member] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 675.032742] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGHEST for action security_group_members [ 675.033285] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.033404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.033474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.033705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.033863] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.033961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.034792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.036609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.036713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.036806] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.148481] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.148706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.148789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.149040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.149135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.149333] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.149427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.149487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.149630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.149707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.149808] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 675.179369] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.180051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.180051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.180051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.180051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.188232] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 675.415036] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-503 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.415036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.415036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.415036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.415036] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.415036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.415036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.415372] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.415372] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.415562] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.415672] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.415821] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.415877] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.415986] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 675.416104] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.416285] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.434655] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.434763] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 675.434886] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.435093] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-503" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.435439] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-384e9d80-8769-4792-adf2-061ac9324da6 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.435634] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-384e9d80-8769-4792-adf2-061ac9324da6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.435771] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-384e9d80-8769-4792-adf2-061ac9324da6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.436127] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-384e9d80-8769-4792-adf2-061ac9324da6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.436296] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('384e9d80-8769-4792-adf2-061ac9324da6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.494562] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.494772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.494840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.495088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.495271] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.495595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.496154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.496154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.496154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.496154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.496351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.496351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.496429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.496540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.496677] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.496770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.496830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.496970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.497083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.497172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.497263] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.503920] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.538819] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.538987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.538987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.539233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.539327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.539544] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.539643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.539697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.539855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.539934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.540041] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 is going to be updated. [ 675.569905] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.570119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.570195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.570456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.570627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.579478] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: IN_PROGRESS for 2s [ 675.938764] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.939330] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.939330] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.939441] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.939580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.939750] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 384e9d80-8769-4792-adf2-061ac9324da6 not found, creating... [ 675.940086] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.940215] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.940375] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.940580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.940746] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.941056] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.941223] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.941337] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.941560] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.941764] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.941957] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 384e9d80-8769-4792-adf2-061ac9324da6 is going to be created. [ 675.972112] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.973242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.973242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.973242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.973419] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.973786] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-384e9d80-8769-4792-adf2-061ac9324da6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.999411] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69b3470e-796f-409b-8367-cd3cf14ca4fb: rpc.has_security_group_logging(os_id): False [ 676.006369] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.023284] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.023428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.023511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.023802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.023924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.024147] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.024266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.024331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.024513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.024596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.024964] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.025226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.025226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.025374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.025458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.025741] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.025855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.025919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.026094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.026186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.026370] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb is going to be created. [ 676.103364] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.103364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.103364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.103364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.103801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.124610] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: IN_PROGRESS for 2s [ 676.509298] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.509465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.509536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.509779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.509859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.509963] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 676.535704] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.535916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.536040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.536306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.536474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.543955] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 676.770357] env[63014]: INFO networking_nsxv3.common.synchronization [req-fb0f0a25-b8fe-4bd2-a585-3ee9a1255d90 req-2a1288fa-0665-45d3-9d0f-1301c7936f72 service nova] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_rules [ 676.770650] env[63014]: INFO networking_nsxv3.common.synchronization [req-fb0f0a25-b8fe-4bd2-a585-3ee9a1255d90 req-2a1288fa-0665-45d3-9d0f-1301c7936f72 service nova] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 676.770944] env[63014]: INFO networking_nsxv3.common.synchronization [req-fb0f0a25-b8fe-4bd2-a585-3ee9a1255d90 req-2a1288fa-0665-45d3-9d0f-1301c7936f72 service nova] Enqueued Resource ID: 384e9d80-8769-4792-adf2-061ac9324da6 with Priority: HIGHEST for action port [ 676.771578] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_rules [ 676.771786] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 676.771949] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384e9d80-8769-4792-adf2-061ac9324da6 with Priority: HIGHEST for action port [ 676.772379] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.772699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.772699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.773008] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.773113] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.775656] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.775802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.776995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-384e9d80-8769-4792-adf2-061ac9324da6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.777270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-384e9d80-8769-4792-adf2-061ac9324da6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.777355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-384e9d80-8769-4792-adf2-061ac9324da6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.777737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-384e9d80-8769-4792-adf2-061ac9324da6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.777737] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('384e9d80-8769-4792-adf2-061ac9324da6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.922888] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c90ff-575c-404c-9432-915836e29303 in Status: SUCCESS [ 676.923388] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c90ff-575c-404c-9432-915836e29303 deletion is rescheduled due to dependency. [ 676.923388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.197358] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 677.197604] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb deletion is rescheduled due to dependency. [ 677.197604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.281761] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.281761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.281761] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 384e9d80-8769-4792-adf2-061ac9324da6 with status ACTIVE [ 677.281761] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.282027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.282107] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.282309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.282404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.282715] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.282715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.282853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.282881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.282952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.283274] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.283417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.283507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.283663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.283764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.283858] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 384e9d80-8769-4792-adf2-061ac9324da6 is going to be updated. [ 677.303126] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.303126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.303312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.303431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.303573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.303800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-384e9d80-8769-4792-adf2-061ac9324da6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.589553] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 in Status: SUCCESS [ 677.589757] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 deletion is rescheduled due to dependency. [ 677.589873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.136919] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: SUCCESS [ 678.137421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.555051] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 678.555051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.555051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.555051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.555051] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.555051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.555675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.555675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.555675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.555675] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.059072] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.562524] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.769528] env[63014]: INFO networking_nsxv3.common.synchronization [req-9b3b7339-a537-4d53-9ea5-5b977a227fc9 req-7ac629b3-9ee5-4b06-80af-298c0e53cae3 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 679.770082] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 679.770387] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.770507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.770574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.773410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.773410] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.773410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.773410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.773410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.773410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.773410] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.064558] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.064730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.064799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.065018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.065182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.065238] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 680.093405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.093736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.093736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.093890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.094050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.102364] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 680.129415] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.129641] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-588" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.129784] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-588" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.130223] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-588" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.130539] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.130958] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.130958] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.131179] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.131335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.131538] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.131653] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.131786] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.131904] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.132036] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.132149] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.132299] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.149986] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.150493] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.150692] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.150811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-588" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.151140] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-1c616bcb-32c1-4667-82d5-943f3da95541 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.152046] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.152046] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.152046] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.152046] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c616bcb-32c1-4667-82d5-943f3da95541',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.279099] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.279266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.279334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.279551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.279689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.279852] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.279950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.280013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.280169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.280244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.280330] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 already deleted. [ 680.280409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.653952] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.654243] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.654328] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.654607] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.654757] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.654970] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 1c616bcb-32c1-4667-82d5-943f3da95541 not found, creating... [ 680.655214] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.655371] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.655516] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.655778] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.655924] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.656224] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.656381] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.656499] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.656708] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.656844] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.660436] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 1c616bcb-32c1-4667-82d5-943f3da95541 is going to be created. [ 680.684691] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.684691] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.684691] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.684691] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.684982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.685861] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.575718] env[63014]: INFO networking_nsxv3.common.synchronization [req-9b3b7339-a537-4d53-9ea5-5b977a227fc9 req-deec2852-76d8-459e-b7bc-79edda1dc58c service nova] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_rules [ 681.575859] env[63014]: INFO networking_nsxv3.common.synchronization [req-9b3b7339-a537-4d53-9ea5-5b977a227fc9 req-deec2852-76d8-459e-b7bc-79edda1dc58c service nova] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 681.575943] env[63014]: INFO networking_nsxv3.common.synchronization [req-9b3b7339-a537-4d53-9ea5-5b977a227fc9 req-deec2852-76d8-459e-b7bc-79edda1dc58c service nova] Enqueued Resource ID: 1c616bcb-32c1-4667-82d5-943f3da95541 with Priority: HIGHEST for action port [ 681.576478] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_rules [ 681.576610] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 681.576713] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c616bcb-32c1-4667-82d5-943f3da95541 with Priority: HIGHEST for action port [ 681.577137] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.577137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.577308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.577814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.577814] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.580691] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.580807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.580875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.581067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.581225] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.581320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.581380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.582619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.582619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.582619] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.582619] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c616bcb-32c1-4667-82d5-943f3da95541 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.582619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.582619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.582876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.582876] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c616bcb-32c1-4667-82d5-943f3da95541',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.085085] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c616bcb-32c1-4667-82d5-943f3da95541 with status ACTIVE [ 682.085396] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.085493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.085554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.086101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.086233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.086445] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.086639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.086724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.086909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.087079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.087279] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.087379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.087435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.087580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.087657] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.087740] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c616bcb-32c1-4667-82d5-943f3da95541 is going to be updated. [ 682.091622] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.091622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.091622] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.110682] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 682.111180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.111343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.111571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.111927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.112094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.112167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.112354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.112445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.112539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.112633] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.114302] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.114430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.114500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.114670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.114813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.114959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.591937] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.616448] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.616650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.616713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.616934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.617131] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.617242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.617302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.617435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.617524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.617620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.617778] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.617944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.617944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.618067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.618188] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.618279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.618336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.618470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.618546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.618625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.618716] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.095718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.096117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.096117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.096215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.096306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.096408] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be created. [ 683.119634] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.119774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.119837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.120973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.120973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.121481] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b31bea8a-6eb8-474e-9f80-c659e23a5477: rpc.has_security_group_logging(os_id): False [ 683.130673] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: UNINITIALIZED for 2s [ 683.139894] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.140480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.140550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.140726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.140819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.141032] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.141132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.141352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.141352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.141442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.141603] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.141695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.141757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.141897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.141970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.142156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.142244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.142292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.142436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.142509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.142591] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 683.163173] env[63014]: INFO networking_nsxv3.common.synchronization [None req-bfee400d-872c-4af1-9fd0-5e7cb9d7034d None None] Enqueued Resource ID: 57d99eea-57c9-402c-9c67-d364bde5c7de with Priority: HIGHEST for action port [ 683.163432] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57d99eea-57c9-402c-9c67-d364bde5c7de with Priority: HIGHEST for action port [ 683.164367] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-57d99eea-57c9-402c-9c67-d364bde5c7de taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.165744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57d99eea-57c9-402c-9c67-d364bde5c7de" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.165829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57d99eea-57c9-402c-9c67-d364bde5c7de" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.166280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57d99eea-57c9-402c-9c67-d364bde5c7de" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.166373] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57d99eea-57c9-402c-9c67-d364bde5c7de',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.204357] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.204493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.204552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.204765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.205086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.220331] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 683.394171] env[63014]: INFO networking_nsxv3.common.synchronization [req-38908eb6-96a7-40d6-aef4-4c21a5f82f09 req-60967ac5-b0f0-419e-af5b-3eb3b23170d6 tempest-ServerMetadataNegativeTestJSON-960167706 tempest-ServerMetadataNegativeTestJSON-960167706-project-member] Enqueued Resource ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 with Priority: HIGHEST for action security_group_members [ 683.394918] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 with Priority: HIGHEST for action security_group_members [ 683.395259] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.395455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.395572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.395913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.396850] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.396850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.396850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.397129] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.397317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.397526] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.668836] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57d99eea-57c9-402c-9c67-d364bde5c7de [ 683.669103] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.669234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.669301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.669510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.669598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.669710] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57d99eea-57c9-402c-9c67-d364bde5c7de already deleted. [ 683.669791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57d99eea-57c9-402c-9c67-d364bde5c7de" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.717858] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.718446] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-281" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.718843] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-281" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.723021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-281" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.723021] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.723021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.723021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.723021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.723021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.723021] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.723021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.723021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.723021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.723021] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 683.723021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.723021] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.742231] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.742395] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 683.742536] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.743519] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-281" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.743519] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-e5457379-017d-42f7-b79c-ea7d15d368e6 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.743519] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-e5457379-017d-42f7-b79c-ea7d15d368e6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.743519] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-e5457379-017d-42f7-b79c-ea7d15d368e6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.743754] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-e5457379-017d-42f7-b79c-ea7d15d368e6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.743795] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5457379-017d-42f7-b79c-ea7d15d368e6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.902165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.902308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.902357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.902569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.902652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.902839] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.902931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.903438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.903438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.903438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.903438] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 already deleted. [ 683.903438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.250220] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.250528] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.250582] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.250829] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.250976] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.251151] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port e5457379-017d-42f7-b79c-ea7d15d368e6 not found, creating... [ 684.251403] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.251558] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.251710] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.251925] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.252080] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.252358] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.253574] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.253574] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.253574] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.253574] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.253574] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: e5457379-017d-42f7-b79c-ea7d15d368e6 is going to be created. [ 684.275635] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.275635] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.275635] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.275635] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.275635] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.275635] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-e5457379-017d-42f7-b79c-ea7d15d368e6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.276090] env[63014]: INFO networking_nsxv3.common.synchronization [None req-3ef03fab-01f7-4f4d-957e-1517671e955c tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 684.276302] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 684.276875] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.276998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.277096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.277359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.277446] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.369393] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d698ad44-cfac-4bd2-91ed-a4523eedfc4f tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 684.369492] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 684.369852] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.369903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.797924] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.798185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.798282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.798522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.798649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.798827] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9141a736-220e-4a6b-b407-916c87c8099c already deleted. [ 684.798950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.799152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.799347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.799531] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.016452] env[63014]: INFO networking_nsxv3.common.synchronization [req-38908eb6-96a7-40d6-aef4-4c21a5f82f09 req-d5510d91-ea7c-49ed-a364-0305c6073fd4 service nova] Enqueued Resource ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 with Priority: HIGHEST for action security_group_rules [ 685.016811] env[63014]: INFO networking_nsxv3.common.synchronization [req-38908eb6-96a7-40d6-aef4-4c21a5f82f09 req-d5510d91-ea7c-49ed-a364-0305c6073fd4 service nova] Enqueued Resource ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 with Priority: HIGHEST for action security_group_members [ 685.016811] env[63014]: INFO networking_nsxv3.common.synchronization [req-38908eb6-96a7-40d6-aef4-4c21a5f82f09 req-d5510d91-ea7c-49ed-a364-0305c6073fd4 service nova] Enqueued Resource ID: e5457379-017d-42f7-b79c-ea7d15d368e6 with Priority: HIGHEST for action port [ 685.016939] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 with Priority: HIGHEST for action security_group_rules [ 685.017045] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 with Priority: HIGHEST for action security_group_members [ 685.017143] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5457379-017d-42f7-b79c-ea7d15d368e6 with Priority: HIGHEST for action port [ 685.017704] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.017854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.017903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.018186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.018261] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.019081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.021257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.021257] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.021257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5457379-017d-42f7-b79c-ea7d15d368e6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5457379-017d-42f7-b79c-ea7d15d368e6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5457379-017d-42f7-b79c-ea7d15d368e6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.021257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5457379-017d-42f7-b79c-ea7d15d368e6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.021257] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5457379-017d-42f7-b79c-ea7d15d368e6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.141458] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: SUCCESS [ 685.142385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.143291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.143585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.143924] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.144235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.144385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.144598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.144759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.144897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.145044] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.234519] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 685.234813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.321382] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.321382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.321382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.321382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.321382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.321382] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9141a736-220e-4a6b-b407-916c87c8099c already deleted. [ 685.321382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.523183] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5457379-017d-42f7-b79c-ea7d15d368e6 with status ACTIVE [ 685.525457] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.525457] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.525457] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.525457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.525457] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5457379-017d-42f7-b79c-ea7d15d368e6 is going to be updated. [ 685.530071] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.530071] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.530071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.546820] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.547018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.547079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.547250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.547453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.547535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5457379-017d-42f7-b79c-ea7d15d368e6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.558101] env[63014]: INFO networking_nsxv3.common.synchronization [None req-5f7b4a7b-eb85-441e-8b09-4151efb7ca25 None None] Enqueued Resource ID: 4cc9b3d6-b4e7-4098-9696-262f518e65ab with Priority: HIGHEST for action port [ 685.558101] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cc9b3d6-b4e7-4098-9696-262f518e65ab with Priority: HIGHEST for action port [ 685.558634] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cc9b3d6-b4e7-4098-9696-262f518e65ab taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.558791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cc9b3d6-b4e7-4098-9696-262f518e65ab" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.558857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cc9b3d6-b4e7-4098-9696-262f518e65ab" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.559180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cc9b3d6-b4e7-4098-9696-262f518e65ab" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.559232] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cc9b3d6-b4e7-4098-9696-262f518e65ab',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.647532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.647743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.647786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.648096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.648686] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.648809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.648889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.649086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.649184] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.649262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.649469] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.649577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.649646] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.649813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.649956] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.651303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.651303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.651303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.651452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.651452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.651509] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.029039] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.061201] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cc9b3d6-b4e7-4098-9696-262f518e65ab [ 686.061431] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.061638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.061638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.061972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.061972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.062087] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cc9b3d6-b4e7-4098-9696-262f518e65ab already deleted. [ 686.062155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cc9b3d6-b4e7-4098-9696-262f518e65ab" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.154924] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd5e74f7-45d3-49de-b068-94f50f961f65: rpc.has_security_group_logging(os_id): False [ 686.178382] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.178573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.178662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.178935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.179067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.179345] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.180165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.180165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.180165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.180165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.180165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.180524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.180524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.180623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.180941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.181165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.181165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.181330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.181488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.181725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.181821] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be created. [ 686.233643] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.235345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.235345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.235345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.235345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.251981] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: IN_PROGRESS for 2s [ 686.532184] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.532501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.532501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.532646] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.532736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.532835] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 is going to be created. [ 686.559788] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.559931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.559999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.560218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.560375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.568741] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 in Status: UNINITIALIZED for 2s [ 688.265706] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: SUCCESS [ 688.265975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.527471] env[63014]: INFO networking_nsxv3.common.synchronization [req-db04b790-5a84-442a-8b7c-7303ba1b1394 req-1322af9d-9ce1-44e7-b73f-b4058adfe8f1 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 688.528016] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 688.528331] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.528837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.528837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.528837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.529183] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.529183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.529183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.529300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.529364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.531968] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.577863] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 in Status: SUCCESS [ 688.578085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.578240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.578451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.578639] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.578826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.578826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.579213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.579213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.579213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.579213] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.837935] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.837935] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-84" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.837935] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-84" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.838380] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-84" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.838648] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.838804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.838927] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.839358] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.839358] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.839589] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.839742] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.839810] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.839922] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.840063] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 688.840170] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.840413] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.858899] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.859080] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 688.859221] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.859414] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-84" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.859741] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-92545b90-2ce8-49b1-a13a-8d389479e03c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.859911] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.860089] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.860397] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.860539] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92545b90-2ce8-49b1-a13a-8d389479e03c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.031419] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.031610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.031688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.031955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.032122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.032399] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.032484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.032677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.032771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.032810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.032919] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca already deleted. [ 689.033047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.082077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.082077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.082077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.082077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.082332] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.082481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.082546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.082711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.082799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.082901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.083063] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.084827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.084827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.084827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.084827] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.084827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.084827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.084827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.084827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.084827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.084827] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.363289] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.363637] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.363637] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.364022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.364174] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.364333] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 92545b90-2ce8-49b1-a13a-8d389479e03c not found, creating... [ 689.365021] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.365021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.365152] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.366628] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.366628] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.366628] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.366628] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.366628] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.366628] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.366628] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.366628] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 92545b90-2ce8-49b1-a13a-8d389479e03c is going to be created. [ 689.390356] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.390613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.390811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.391119] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.391357] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.395201] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.588017] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9: rpc.has_security_group_logging(os_id): False [ 689.610995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.611160] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.611237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.611629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.611629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.611766] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.611872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.611938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.612141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.612251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.612436] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.612548] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.612610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.612753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.612830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.613015] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.614358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.614358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.614572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.614666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.614760] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 is going to be created. [ 689.676480] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.676699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.676924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.677311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.677563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.688252] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 in Status: IN_PROGRESS for 2s [ 690.079929] env[63014]: INFO networking_nsxv3.common.synchronization [req-db04b790-5a84-442a-8b7c-7303ba1b1394 req-9a401865-8c50-4568-a80b-959225758678 service nova] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 690.079929] env[63014]: INFO networking_nsxv3.common.synchronization [req-db04b790-5a84-442a-8b7c-7303ba1b1394 req-9a401865-8c50-4568-a80b-959225758678 service nova] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 690.079929] env[63014]: INFO networking_nsxv3.common.synchronization [req-db04b790-5a84-442a-8b7c-7303ba1b1394 req-9a401865-8c50-4568-a80b-959225758678 service nova] Enqueued Resource ID: 92545b90-2ce8-49b1-a13a-8d389479e03c with Priority: HIGHEST for action port [ 690.079929] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 690.079929] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 690.079929] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92545b90-2ce8-49b1-a13a-8d389479e03c with Priority: HIGHEST for action port [ 690.079929] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.079929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.080778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.081326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.081539] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.082782] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.082955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.083109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.083340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.084943] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.085115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.085212] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.085479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.085608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.085729] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.086616] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-92545b90-2ce8-49b1-a13a-8d389479e03c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.086945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.087062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.087594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.087594] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92545b90-2ce8-49b1-a13a-8d389479e03c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.589107] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.589383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.589449] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.591031] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92545b90-2ce8-49b1-a13a-8d389479e03c with status ACTIVE [ 690.591031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.591031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.591031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.591031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.591031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.591280] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.591280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.591280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.591387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.591461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.591641] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.591730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.591806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.591956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.592042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.594780] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92545b90-2ce8-49b1-a13a-8d389479e03c is going to be updated. [ 690.610692] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.610832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.610902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.611373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.611526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.611695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.984199] env[63014]: INFO networking_nsxv3.common.synchronization [req-2ae867a0-3a73-4250-8f6f-0efe69816030 req-b695a320-f69c-412c-9cd5-4a79745a5e7d tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 690.984199] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 690.984199] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.984199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.984199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.984907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.985352] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.985695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.985876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.986143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.986542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.986909] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.095316] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.363399] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.364527] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.364719] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.365127] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.365409] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.365568] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.365682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.366062] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.366274] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.366531] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.366731] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.370639] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.370639] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.370639] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 691.370639] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.370639] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.389189] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.389364] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 691.389496] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.389677] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.390110] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.390296] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.390452] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.390728] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.390999] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.489124] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.489282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.489413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.489563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.489790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.489840] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.489934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.489992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.490151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.490223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.490306] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a already deleted. [ 691.490388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.601982] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.604106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.604106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.604106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.604106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.604106] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be created. [ 691.625271] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.625420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.626106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.626106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.626106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.634260] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: UNINITIALIZED for 2s [ 691.702466] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 in Status: SUCCESS [ 691.702902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.893603] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.893906] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.894110] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.894345] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.894495] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.894654] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d not found, creating... [ 691.894962] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.895146] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.895260] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.895478] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.895614] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.895894] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.896058] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.896242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.896453] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.896588] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.896724] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d is going to be created. [ 691.914876] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.915106] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.915236] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.915484] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.916568] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.916568] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.616876] env[63014]: INFO networking_nsxv3.common.synchronization [req-2ae867a0-3a73-4250-8f6f-0efe69816030 req-28422d00-851d-48c8-8c8c-84a006b4eb2f service nova] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_rules [ 692.617204] env[63014]: INFO networking_nsxv3.common.synchronization [req-2ae867a0-3a73-4250-8f6f-0efe69816030 req-28422d00-851d-48c8-8c8c-84a006b4eb2f service nova] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 692.617204] env[63014]: INFO networking_nsxv3.common.synchronization [req-2ae867a0-3a73-4250-8f6f-0efe69816030 req-28422d00-851d-48c8-8c8c-84a006b4eb2f service nova] Enqueued Resource ID: 86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d with Priority: HIGHEST for action port [ 692.617485] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_rules [ 692.617564] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 692.617654] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d with Priority: HIGHEST for action port [ 692.618369] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.618463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.618514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.618712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.618787] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.619638] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.619734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.619812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.620086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.620178] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.620303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.620303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.620424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.620510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.620752] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.623482] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.623619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.623686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.623875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.623979] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.126197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.126197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.126197] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d with status ACTIVE [ 693.126197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.126197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.126197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.126565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.126565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.126698] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.126777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.126805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.126950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.127068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.127247] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.127339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.127473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.127534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.127607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.127691] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d is going to be updated. [ 693.128771] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.149336] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.149461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.149526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.149746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.149882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.150069] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86bc3691-9d69-4cfb-8a96-9d1edfdd0a4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.632971] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.646591] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 693.646591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.646591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.646591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.646591] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.646591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.646591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.646591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.646591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.646591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.646591] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.788453] env[63014]: INFO networking_nsxv3.common.synchronization [req-696a2193-ede9-4fb3-b7eb-d7aa95ee7325 req-255b0771-0bf8-4216-b981-d01448824973 tempest-AttachVolumeTestJSON-1387786992 tempest-AttachVolumeTestJSON-1387786992-project-member] Enqueued Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_members [ 693.789037] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_members [ 693.789349] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.789477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.789534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.789757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.789927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.791934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.792059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.792203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.792924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.792924] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.136020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.136020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.136020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.136162] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.136194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.137048] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a is going to be created. [ 694.150290] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.150443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.150523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.150744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.150917] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.151037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.151103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.151232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.151321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.151426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.151554] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.151642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.151758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.151867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.152015] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.152109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.152192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.152298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.152372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.152451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.152542] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.158248] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.158370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.158370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.158525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.158676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.167838] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: UNINITIALIZED for 2s [ 694.294812] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.295724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.295724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.295724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.295724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.295724] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.295724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.297939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.297939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.297939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.297939] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 already deleted. [ 694.297939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.488613] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.488613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-487" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.488613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-487" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.488613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-487" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.488613] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.488613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.488613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.488613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.488613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.488613] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.488613] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.488613] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.488613] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.489615] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.489615] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.489615] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.489615] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.489615] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.489615] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.489615] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-487" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.489615] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-40f3cb91-161d-4024-b298-4969865d0193 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.489615] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-40f3cb91-161d-4024-b298-4969865d0193" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.489615] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-40f3cb91-161d-4024-b298-4969865d0193" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.489615] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-40f3cb91-161d-4024-b298-4969865d0193" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.489615] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f3cb91-161d-4024-b298-4969865d0193',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.656648] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98c66d04-d431-433a-9b0a-4fec6e74caca: rpc.has_security_group_logging(os_id): False [ 694.677561] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.677722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.677790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.678037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.678145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.678366] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.678494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.678569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.678748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.678832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.679043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.679145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.679299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.679469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.679582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.679810] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.679962] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.680010] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.680168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.680263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.680354] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be created. [ 694.743900] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.744149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.744221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.744435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.744618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.754677] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 694.918036] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.918036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.918238] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.918619] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.918619] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.918769] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 40f3cb91-161d-4024-b298-4969865d0193 not found, creating... [ 694.918970] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.919078] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.919183] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.919807] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.919807] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.919807] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.919969] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.920838] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.921080] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.921175] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.921329] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 40f3cb91-161d-4024-b298-4969865d0193 is going to be created. [ 694.949035] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.949345] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.949405] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.949669] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.949897] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.950130] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-40f3cb91-161d-4024-b298-4969865d0193" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.097910] env[63014]: INFO networking_nsxv3.common.synchronization [req-696a2193-ede9-4fb3-b7eb-d7aa95ee7325 req-94732f16-4e75-4d8f-8a13-f9d6c4956885 service nova] Enqueued Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_rules [ 696.098243] env[63014]: INFO networking_nsxv3.common.synchronization [req-696a2193-ede9-4fb3-b7eb-d7aa95ee7325 req-94732f16-4e75-4d8f-8a13-f9d6c4956885 service nova] Enqueued Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_members [ 696.098330] env[63014]: INFO networking_nsxv3.common.synchronization [req-696a2193-ede9-4fb3-b7eb-d7aa95ee7325 req-94732f16-4e75-4d8f-8a13-f9d6c4956885 service nova] Enqueued Resource ID: 40f3cb91-161d-4024-b298-4969865d0193 with Priority: HIGHEST for action port [ 696.098524] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_rules [ 696.098686] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_members [ 696.098829] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40f3cb91-161d-4024-b298-4969865d0193 with Priority: HIGHEST for action port [ 696.099500] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.099617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.099691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.099909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.100018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.100879] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.101057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.101117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.101291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.101494] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.101607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.101672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.101872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.101949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.102416] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.104062] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-40f3cb91-161d-4024-b298-4969865d0193 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.104271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40f3cb91-161d-4024-b298-4969865d0193" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.104600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40f3cb91-161d-4024-b298-4969865d0193" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.104733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40f3cb91-161d-4024-b298-4969865d0193" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.104843] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40f3cb91-161d-4024-b298-4969865d0193',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.178914] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: SUCCESS [ 696.178914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.178914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.179137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.179240] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.180206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.180206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.180206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.180206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.180206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.180206] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.609176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.609176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.609176] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.609176] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40f3cb91-161d-4024-b298-4969865d0193 with status ACTIVE [ 696.609176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.609576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.609576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.609576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.609576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.609802] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.609883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.609947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.611468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.611468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.611468] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.611468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.611468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.611468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.611468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.611468] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40f3cb91-161d-4024-b298-4969865d0193 is going to be updated. [ 696.645535] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.645705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.645780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.646058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.646222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.646404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40f3cb91-161d-4024-b298-4969865d0193" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.682726] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.683072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.683161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.683420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.683625] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.683758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.683893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.684112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.684219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.684339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.684511] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.684612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.684682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.684861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.685128] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.685234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.685298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.685473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.685560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.685663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.685769] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.768214] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 696.768908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.799022] env[63014]: INFO networking_nsxv3.common.synchronization [req-be2b878b-e5ce-41b2-96b8-97e912c5bb66 req-1c217601-464c-4207-b3f5-b32d0e476b67 tempest-AttachInterfacesV270Test-1569833341 tempest-AttachInterfacesV270Test-1569833341-project-member] Enqueued Resource ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a with Priority: HIGHEST for action security_group_members [ 696.799896] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a with Priority: HIGHEST for action security_group_members [ 696.800331] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.800573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.800746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.801115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.801367] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.801558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.801712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.801972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.802729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.802729] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab84161a-cc47-4bb7-8bc3-f695a8be1c0a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.117190] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.193882] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a: rpc.has_security_group_logging(os_id): False [ 697.211474] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.212229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.212559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.215286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.215286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.215286] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.215286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.215286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.215286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.215286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.215286] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.215286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.215286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.215788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.216297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.216560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.216682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.216731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.218436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.218436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.218436] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a is going to be created. [ 697.270774] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.272026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.272026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.272026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.272026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.286306] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: IN_PROGRESS for 2s [ 697.306292] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.306292] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.306292] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a already deleted. [ 697.306292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.446034] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.446034] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-613" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.446034] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-613" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.446034] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-613" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.446310] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.446422] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.446540] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.446797] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.446900] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.447123] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.447237] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.447346] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.447452] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.447561] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 697.447665] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.447797] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.466108] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.466320] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 697.466473] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.466688] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-613" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.467067] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-dac28dc0-99a4-4818-b1b8-38e609bed90a taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.467249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-dac28dc0-99a4-4818-b1b8-38e609bed90a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.467369] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-dac28dc0-99a4-4818-b1b8-38e609bed90a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.467660] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-dac28dc0-99a4-4818-b1b8-38e609bed90a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.467799] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac28dc0-99a4-4818-b1b8-38e609bed90a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.620318] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.620468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.620740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.620841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.621648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.621648] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 is going to be created. [ 697.645123] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.645303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.645378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.645592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.645754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.654287] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546a1fbc-63de-4ead-af89-1f218af29386 in Status: UNINITIALIZED for 2s [ 697.898435] env[63014]: INFO networking_nsxv3.common.synchronization [req-4b07a0e3-f454-42c9-9fe4-c286eaf79919 req-72059479-05e7-4435-a605-b158493507cb tempest-ServerMetadataNegativeTestJSON-960167706 tempest-ServerMetadataNegativeTestJSON-960167706-project-member] Enqueued Resource ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 with Priority: HIGHEST for action security_group_members [ 697.899191] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 with Priority: HIGHEST for action security_group_members [ 697.900319] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.900319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.900319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.900319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.900319] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.900319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.900319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.900739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.900937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.901409] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.970486] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.970486] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.970486] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.970876] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.970876] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.971422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port dac28dc0-99a4-4818-b1b8-38e609bed90a not found, creating... [ 697.971751] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.971922] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.972056] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.972482] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.972632] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.973224] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.973355] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.973418] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.973636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.973839] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.973999] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: dac28dc0-99a4-4818-b1b8-38e609bed90a is going to be created. [ 697.995029] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.995235] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.995369] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.995642] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.996042] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.996126] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-dac28dc0-99a4-4818-b1b8-38e609bed90a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.396358] env[63014]: INFO networking_nsxv3.common.synchronization [req-224c4eb5-eb0c-43ce-9136-c860a95fb20c req-442091e5-9e28-482b-9df2-1335882fbc31 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 698.396699] env[63014]: INFO networking_nsxv3.common.synchronization [req-224c4eb5-eb0c-43ce-9136-c860a95fb20c req-442091e5-9e28-482b-9df2-1335882fbc31 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 698.397443] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 698.397615] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 698.398034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.398179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.398274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.398488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.398849] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.398849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.399031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.399075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.399174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.399271] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.400457] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.400567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.402358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.402358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.402358] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.402358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.402358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.402358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.402358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.402358] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.410188] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.410313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.410379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.410581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.410669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.410858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.410951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.411022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.411178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.411252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.411338] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 is going to be updated. [ 698.441165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.441385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.441486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.441753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.441923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.450673] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 in Status: IN_PROGRESS for 2s [ 698.533671] env[63014]: INFO networking_nsxv3.common.synchronization [req-224c4eb5-eb0c-43ce-9136-c860a95fb20c req-442091e5-9e28-482b-9df2-1335882fbc31 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_rules [ 698.533671] env[63014]: INFO networking_nsxv3.common.synchronization [req-224c4eb5-eb0c-43ce-9136-c860a95fb20c req-442091e5-9e28-482b-9df2-1335882fbc31 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 698.533671] env[63014]: INFO networking_nsxv3.common.synchronization [req-224c4eb5-eb0c-43ce-9136-c860a95fb20c req-442091e5-9e28-482b-9df2-1335882fbc31 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 698.533671] env[63014]: INFO networking_nsxv3.common.synchronization [req-224c4eb5-eb0c-43ce-9136-c860a95fb20c req-442091e5-9e28-482b-9df2-1335882fbc31 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 698.533671] env[63014]: INFO networking_nsxv3.common.synchronization [req-224c4eb5-eb0c-43ce-9136-c860a95fb20c req-442091e5-9e28-482b-9df2-1335882fbc31 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 92545b90-2ce8-49b1-a13a-8d389479e03c with Priority: HIGHEST for action port [ 698.534579] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_rules [ 698.534743] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 698.534955] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92545b90-2ce8-49b1-a13a-8d389479e03c with Priority: HIGHEST for action port [ 698.535083] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 698.535172] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 698.535454] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.535924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.535993] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.536257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.536334] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.538174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.538174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.538174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.538174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.538174] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.538461] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-92545b90-2ce8-49b1-a13a-8d389479e03c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.538564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.538626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.538820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.538854] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92545b90-2ce8-49b1-a13a-8d389479e03c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.539768] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.539855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.540039] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.540119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.903567] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.906223] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.934999] env[63014]: INFO networking_nsxv3.common.synchronization [req-be2b878b-e5ce-41b2-96b8-97e912c5bb66 req-1783914e-7109-436b-9846-dbfe818421c5 service nova] Enqueued Resource ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a with Priority: HIGHEST for action security_group_rules [ 698.937156] env[63014]: INFO networking_nsxv3.common.synchronization [req-be2b878b-e5ce-41b2-96b8-97e912c5bb66 req-1783914e-7109-436b-9846-dbfe818421c5 service nova] Enqueued Resource ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a with Priority: HIGHEST for action security_group_members [ 698.937156] env[63014]: INFO networking_nsxv3.common.synchronization [req-be2b878b-e5ce-41b2-96b8-97e912c5bb66 req-1783914e-7109-436b-9846-dbfe818421c5 service nova] Enqueued Resource ID: dac28dc0-99a4-4818-b1b8-38e609bed90a with Priority: HIGHEST for action port [ 698.937156] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a with Priority: HIGHEST for action security_group_rules [ 698.937156] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a with Priority: HIGHEST for action security_group_members [ 698.937156] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dac28dc0-99a4-4818-b1b8-38e609bed90a with Priority: HIGHEST for action port [ 698.937737] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.938024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.938574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.938983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.939212] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ab84161a-cc47-4bb7-8bc3-f695a8be1c0a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.940612] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.940612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.942178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.942178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.942178] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.942178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.942178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.942178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.942178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.942178] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab84161a-cc47-4bb7-8bc3-f695a8be1c0a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.943438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-dac28dc0-99a4-4818-b1b8-38e609bed90a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.943542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dac28dc0-99a4-4818-b1b8-38e609bed90a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.943601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dac28dc0-99a4-4818-b1b8-38e609bed90a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.943756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dac28dc0-99a4-4818-b1b8-38e609bed90a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.943869] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dac28dc0-99a4-4818-b1b8-38e609bed90a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.040995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.041197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.041487] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.041577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.041758] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92545b90-2ce8-49b1-a13a-8d389479e03c with status ACTIVE [ 699.041956] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.042045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.042128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.042312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.042415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.042606] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.042707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.042758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.042928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.043029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.043202] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.043323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.043420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.043538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.043613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.043697] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92545b90-2ce8-49b1-a13a-8d389479e03c is going to be updated. [ 699.064593] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.064852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.064852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.065183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.065868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.066105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.197498] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGHEST for action security_group_members [ 699.197736] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 699.197825] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 699.198450] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGHEST for action security_group_members [ 699.198592] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 699.198699] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 699.198929] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3082e67-cc51-4dbb-a0f9-69738e0314d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.199061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.199166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.199389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.199544] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.199645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.199709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.199864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.199952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.200064] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.201349] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.201349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.201507] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.201669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_rules [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGHEST for action security_group_rules [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGHEST for action security_group_members [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [req-198fff5a-923f-49d9-aa6c-668953b4458f req-5618e710-ea18-4507-925d-fabc5d2e8479 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 92545b90-2ce8-49b1-a13a-8d389479e03c with Priority: HIGHEST for action port [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_rules [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 699.262019] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGHEST for action security_group_members [ 699.262966] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92545b90-2ce8-49b1-a13a-8d389479e03c with Priority: HIGHEST for action port [ 699.265072] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGHEST for action security_group_rules [ 699.265072] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 699.265072] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 699.265072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.265072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.265072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.265072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.265072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3082e67-cc51-4dbb-a0f9-69738e0314d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.265072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.265072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-92545b90-2ce8-49b1-a13a-8d389479e03c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.265072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.265072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.265592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.265592] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92545b90-2ce8-49b1-a13a-8d389479e03c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.266274] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.266413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.266481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.266844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.266932] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.268084] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.268181] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.268411] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.268492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.298052] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: SUCCESS [ 699.298161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.410803] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.411571] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.445810] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.445810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.445810] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dac28dc0-99a4-4818-b1b8-38e609bed90a with status ACTIVE [ 699.445966] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.446120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.446252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.446845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.446845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.447011] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.447011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.451176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.451176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.451321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.451565] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.451684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.451843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.451956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.452118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.452228] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dac28dc0-99a4-4818-b1b8-38e609bed90a is going to be updated. [ 699.453304] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ab84161a-cc47-4bb7-8bc3-f695a8be1c0a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.473520] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.473731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.473731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.474594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.474594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.474594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dac28dc0-99a4-4818-b1b8-38e609bed90a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.666086] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546a1fbc-63de-4ead-af89-1f218af29386 in Status: SUCCESS [ 699.666086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.666086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.666086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.666086] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.666086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.666086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.666086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.666086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.666086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.666086] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.702957] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.770970] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92545b90-2ce8-49b1-a13a-8d389479e03c with status ACTIVE [ 699.770970] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.770970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.770970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.770970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.770970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.770970] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.771368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.771368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.771498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.771584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.771771] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.771921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.772026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.773200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.773200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.773200] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92545b90-2ce8-49b1-a13a-8d389479e03c is going to be updated. [ 699.773882] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3082e67-cc51-4dbb-a0f9-69738e0314d0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.773993] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.797212] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.797352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.797423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.797619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.798570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.798570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92545b90-2ce8-49b1-a13a-8d389479e03c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.914620] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.914620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.917522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.917522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.917522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.917522] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 699.917522] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.917522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.917522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.917522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.917522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.917522] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc is going to be created. [ 699.956700] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ab84161a-cc47-4bb7-8bc3-f695a8be1c0a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.961733] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.961733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.961733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.961733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.961733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.966022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.966022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.966022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.966022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.966022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.970396] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: UNINITIALIZED for 2s [ 699.972263] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 700.170022] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.204804] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.458913] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.461165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.461165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.461165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.461165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.461165] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a is going to be created. [ 700.462092] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 in Status: SUCCESS [ 700.462828] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9 deletion is rescheduled due to dependency. [ 700.462828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.481964] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.482179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.482277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.482511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.482750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.494130] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a in Status: UNINITIALIZED for 2s [ 700.674881] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 546a1fbc-63de-4ead-af89-1f218af29386: rpc.has_security_group_logging(os_id): False [ 700.696204] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.696376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.696453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.696656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.696720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.696967] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.697072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.697173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.697303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.697367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.697438] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 is going to be created. [ 700.707392] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.707559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.707622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.707789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.707850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.707951] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 is going to be created. [ 700.740125] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.740361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.740489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.740742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.740955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.751582] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: UNINITIALIZED for 2s [ 700.765979] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.765979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.765979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.765979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.765979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.773624] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546a1fbc-63de-4ead-af89-1f218af29386 in Status: IN_PROGRESS for 2s [ 701.981318] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: SUCCESS [ 701.981591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.981687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.981904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.982107] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.982224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.982296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.982454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.982584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.982656] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.984203] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 701.984354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.984496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.984728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.984844] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.984981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.985068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.985215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.985299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.985387] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.141251] env[63014]: INFO networking_nsxv3.common.synchronization [req-6a59db37-bf22-4129-9c0e-e98ccaabc6b1 req-4260b698-eb0c-428e-9316-2b0c861fd740 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 702.141420] env[63014]: INFO networking_nsxv3.common.synchronization [req-6a59db37-bf22-4129-9c0e-e98ccaabc6b1 req-4260b698-eb0c-428e-9316-2b0c861fd740 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe with Priority: HIGHEST for action security_group_members [ 702.142077] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 702.142181] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe with Priority: HIGHEST for action security_group_members [ 702.142461] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.142580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.142647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.142862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.143038] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.143141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.143203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.143491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.143647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.143684] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.148020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c5f6b39-6381-49b0-a7e7-6087b06083fe taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.148020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.148020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.148020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.148020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.148020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.148020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.148020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.148020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.148020] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.209095] env[63014]: INFO networking_nsxv3.common.synchronization [req-6a59db37-bf22-4129-9c0e-e98ccaabc6b1 req-4260b698-eb0c-428e-9316-2b0c861fd740 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe with Priority: HIGHEST for action security_group_rules [ 702.209364] env[63014]: INFO networking_nsxv3.common.synchronization [req-6a59db37-bf22-4129-9c0e-e98ccaabc6b1 req-4260b698-eb0c-428e-9316-2b0c861fd740 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe with Priority: HIGHEST for action security_group_members [ 702.209748] env[63014]: INFO networking_nsxv3.common.synchronization [req-6a59db37-bf22-4129-9c0e-e98ccaabc6b1 req-4260b698-eb0c-428e-9316-2b0c861fd740 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_rules [ 702.209893] env[63014]: INFO networking_nsxv3.common.synchronization [req-6a59db37-bf22-4129-9c0e-e98ccaabc6b1 req-4260b698-eb0c-428e-9316-2b0c861fd740 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 702.210122] env[63014]: INFO networking_nsxv3.common.synchronization [req-6a59db37-bf22-4129-9c0e-e98ccaabc6b1 req-4260b698-eb0c-428e-9316-2b0c861fd740 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: 1c616bcb-32c1-4667-82d5-943f3da95541 with Priority: HIGHEST for action port [ 702.211113] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe with Priority: HIGHEST for action security_group_rules [ 702.211257] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_rules [ 702.211603] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c616bcb-32c1-4667-82d5-943f3da95541 with Priority: HIGHEST for action port [ 702.211702] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe with Priority: HIGHEST for action security_group_members [ 702.211832] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 702.212439] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c5f6b39-6381-49b0-a7e7-6087b06083fe taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.212816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.212893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.213469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.213600] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.219037] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.219037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.219037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.219037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.219037] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.219037] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c616bcb-32c1-4667-82d5-943f3da95541 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.219037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.219037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.219037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.219037] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c616bcb-32c1-4667-82d5-943f3da95541',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.219037] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c5f6b39-6381-49b0-a7e7-6087b06083fe taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.219037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.219037] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.219037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.486915] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.487769] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.503291] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a in Status: SUCCESS [ 702.503510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.503953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.504186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.504380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.504488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.504554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.504704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.504785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.504891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.504990] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ab84161a-cc47-4bb7-8bc3-f695a8be1c0a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.650268] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.651235] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.720941] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c5f6b39-6381-49b0-a7e7-6087b06083fe taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.720941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.720941] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.720941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.721350] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c616bcb-32c1-4667-82d5-943f3da95541 with status ACTIVE [ 702.721350] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.721350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.721453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.721676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.721853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.723341] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.723341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.723341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.723341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.723341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.723341] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.723341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.723341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.723341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.723341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.723341] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c616bcb-32c1-4667-82d5-943f3da95541 is going to be updated. [ 702.745511] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.745511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.745511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.745511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.745511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.745511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.765285] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: SUCCESS [ 702.765285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.765285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.765285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.765285] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.765571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.765571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.765723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.765787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.765891] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.785303] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546a1fbc-63de-4ead-af89-1f218af29386 in Status: SUCCESS [ 702.785790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.989999] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.990941] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.010916] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.011115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.011185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.011348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.011510] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.011610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.011731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.011846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.011934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.012149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.012322] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.012406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.012461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.012609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.012741] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.012824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.012890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.013022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.013106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.013208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.013296] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ab84161a-cc47-4bb7-8bc3-f695a8be1c0a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.153180] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.154418] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.271076] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.428435] env[63014]: INFO networking_nsxv3.common.synchronization [req-b5a15149-a414-4e4d-be95-e0a0efb7e001 req-7f0be959-9f8a-44b1-b698-19476cff32c3 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe with Priority: HIGHEST for action security_group_members [ 703.428435] env[63014]: INFO networking_nsxv3.common.synchronization [req-b5a15149-a414-4e4d-be95-e0a0efb7e001 req-7f0be959-9f8a-44b1-b698-19476cff32c3 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 703.428955] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe with Priority: HIGHEST for action security_group_members [ 703.430375] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 703.430682] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c5f6b39-6381-49b0-a7e7-6087b06083fe taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.430783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.431073] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.431073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.489057] env[63014]: INFO networking_nsxv3.common.synchronization [req-b5a15149-a414-4e4d-be95-e0a0efb7e001 req-7f0be959-9f8a-44b1-b698-19476cff32c3 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_rules [ 703.489057] env[63014]: INFO networking_nsxv3.common.synchronization [req-b5a15149-a414-4e4d-be95-e0a0efb7e001 req-7f0be959-9f8a-44b1-b698-19476cff32c3 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 703.489057] env[63014]: INFO networking_nsxv3.common.synchronization [req-b5a15149-a414-4e4d-be95-e0a0efb7e001 req-7f0be959-9f8a-44b1-b698-19476cff32c3 tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: 1c616bcb-32c1-4667-82d5-943f3da95541 with Priority: HIGHEST for action port [ 703.489057] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_rules [ 703.489057] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 703.489057] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c616bcb-32c1-4667-82d5-943f3da95541 with Priority: HIGHEST for action port [ 703.489057] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.489057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.489057] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.489057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.489832] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c616bcb-32c1-4667-82d5-943f3da95541 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.490062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.490224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.490511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.490869] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c616bcb-32c1-4667-82d5-943f3da95541',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.492677] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.492919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.493088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.493347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.493532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.493727] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc is going to be updated. [ 703.497657] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.497769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.497836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.498052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.498148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.498237] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 703.515108] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ab84161a-cc47-4bb7-8bc3-f695a8be1c0a: rpc.has_security_group_logging(os_id): False [ 703.528662] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.528984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.528984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.529091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.529246] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.538525] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.538769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.538769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.538928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.539082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.541778] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.541949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.542058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.542473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.542473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.542654] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.542776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.542859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.543043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.543418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.543418] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.543547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.544049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.544207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.544329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.548887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.548887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.548887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.548887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.548887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.548887] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a is going to be created. [ 703.550437] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: IN_PROGRESS for 2s [ 703.556974] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 703.605947] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.605947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.605947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.605947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.606546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.617447] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a in Status: IN_PROGRESS for 2s [ 703.656107] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.656276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.656383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.656600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.656683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.656784] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be updated. [ 703.658204] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.658410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.658465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.658735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.658735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.658827] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe is going to be created. [ 703.722796] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.722983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.723071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.723288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.723481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.747204] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.747204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.747204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.747351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.747451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.762738] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe in Status: UNINITIALIZED for 2s [ 703.779047] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: IN_PROGRESS for 2s [ 703.779317] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.808938] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ae23f1c6-3441-4586-954c-f42b9cde6c18 None None] Enqueued Resource ID: 8a69f431-defb-40be-b1d2-b6756c508c22 with Priority: HIGHEST for action port [ 703.809486] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a69f431-defb-40be-b1d2-b6756c508c22 with Priority: HIGHEST for action port [ 703.809808] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a69f431-defb-40be-b1d2-b6756c508c22 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.809964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a69f431-defb-40be-b1d2-b6756c508c22" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.809998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a69f431-defb-40be-b1d2-b6756c508c22" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.810296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a69f431-defb-40be-b1d2-b6756c508c22" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.810379] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a69f431-defb-40be-b1d2-b6756c508c22',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.993050] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c616bcb-32c1-4667-82d5-943f3da95541 with status ACTIVE [ 703.993533] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.993764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.993871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.994105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.994196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.994391] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.994489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.994675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.994749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.994820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.994977] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.995082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.995151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.995282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.995350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.995440] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c616bcb-32c1-4667-82d5-943f3da95541 is going to be updated. [ 704.021034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.021170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.021170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.022203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.022203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.022203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c616bcb-32c1-4667-82d5-943f3da95541" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.283451] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.283651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.283651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.283893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.283992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.284104] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 is going to be updated. [ 704.310141] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.310374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.310374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.310585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.310702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.316223] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a69f431-defb-40be-b1d2-b6756c508c22 [ 704.316514] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.316692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.316767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.317055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.317176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.318362] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a69f431-defb-40be-b1d2-b6756c508c22 already deleted. [ 704.318471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a69f431-defb-40be-b1d2-b6756c508c22" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.321871] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: IN_PROGRESS for 2s [ 705.565263] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: SUCCESS [ 705.565564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.565715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.565946] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.566203] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.566340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.566432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.566624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.566728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.566832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.566933] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.571890] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 705.571890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.571890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.571890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.571890] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.571890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.572138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.572138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.572197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.572914] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.574290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.574290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.574290] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.574290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.574290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.574525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.574525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.574582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.575277] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.576630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.576757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.576926] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.577098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.577189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.577456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.577591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.577666] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.628462] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a in Status: SUCCESS [ 705.628691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.775401] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe in Status: SUCCESS [ 705.775401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.775401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.775401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.775401] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.775401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.775401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.775401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.775401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.775401] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.788260] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: SUCCESS [ 705.788462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.788611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.788817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.789021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.789135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.789199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.789354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.789437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.790619] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.076790] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.077783] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.082424] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.083130] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.083229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.276944] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.276944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.277095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.277314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.277407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.277649] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.277777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.277853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.278041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.278139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.278245] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe is going to be deleted. [ 706.294037] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.338111] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: SUCCESS [ 706.338397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.338522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.338677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.338875] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.338990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.339075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.339240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.339324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.339410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.339500] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.370216] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.370366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.370438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.370652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.370745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.370852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.371470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.371648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.371821] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.371955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.372522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.372522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.372522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.372522] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.583355] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.586281] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 153c5776-28ea-4b88-b692-fc1ee145e6dc: rpc.has_security_group_logging(os_id): False [ 706.588240] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.626515] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.626763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.626877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.627238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.627405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.627753] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.627974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.628050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.628276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.628418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.628571] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc is going to be created. [ 706.690360] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.690558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.690768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.691040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.691229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.709500] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: IN_PROGRESS for 2s [ 706.797105] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.805332] env[63014]: INFO networking_nsxv3.common.synchronization [None req-145d5a99-9ca8-41a3-a9cb-52d16a710354 None None] Enqueued Resource ID: 5a4f18ad-86e6-43e9-84ca-ec84e9547ce7 with Priority: HIGHEST for action port [ 706.805332] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a4f18ad-86e6-43e9-84ca-ec84e9547ce7 with Priority: HIGHEST for action port [ 706.805738] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a4f18ad-86e6-43e9-84ca-ec84e9547ce7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.805869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a4f18ad-86e6-43e9-84ca-ec84e9547ce7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.805938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a4f18ad-86e6-43e9-84ca-ec84e9547ce7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.806249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a4f18ad-86e6-43e9-84ca-ec84e9547ce7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.806339] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a4f18ad-86e6-43e9-84ca-ec84e9547ce7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.841414] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.875589] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.875724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.875808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.876103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.877029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.877029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.877029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.877029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.877029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.877407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.877407] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe already deleted. [ 706.877407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.877502] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.878601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.878835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.879080] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.879240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.879341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.879559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.879683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.879818] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.088786] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.088949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.089047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.089295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.089399] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.089482] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc is going to be updated. [ 707.090760] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.090897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.090956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.091109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.091195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.091283] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 707.207057] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.207057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.207057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.207057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.207057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.230461] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: IN_PROGRESS for 2s [ 707.251493] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.252730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.252730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.252893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.252935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.272528] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 707.300551] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.300707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.300782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.301020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.301146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.301217] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be updated. [ 707.311019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a4f18ad-86e6-43e9-84ca-ec84e9547ce7 [ 707.311019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.311019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.311019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.311019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.311019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.311019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a4f18ad-86e6-43e9-84ca-ec84e9547ce7 already deleted. [ 707.311019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a4f18ad-86e6-43e9-84ca-ec84e9547ce7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.333614] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.334060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.334060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.334168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.334302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.343510] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3082e67-cc51-4dbb-a0f9-69738e0314d0: rpc.has_security_group_logging(os_id): False [ 707.345898] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: IN_PROGRESS for 2s [ 707.363113] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.363292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.363385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.363744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.363744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.363945] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.364306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.364306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.364306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.364411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.364464] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 is going to be created. [ 707.382263] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c5f6b39-6381-49b0-a7e7-6087b06083fe',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.382998] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.383167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.383254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.383549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.383655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.383857] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.383974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.384052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.384439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.384536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.384628] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe already deleted. [ 707.384868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.439359] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.439572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.439572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.439876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.439935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.452405] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: IN_PROGRESS for 2s [ 707.887465] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c5f6b39-6381-49b0-a7e7-6087b06083fe: rpc.has_security_group_logging(os_id): False [ 707.906144] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.906307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.906374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.906588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.906681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.906902] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.907009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.907081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.907231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.907310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.907396] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe is going to be created. [ 707.943889] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5c5f6b39-6381-49b0-a7e7-6087b06083fe], does not exist path=[/infra/domains/default/groups/5c5f6b39-6381-49b0-a7e7-6087b06083fe]."\n}' [ 707.944116] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5c5f6b39-6381-49b0-a7e7-6087b06083fe [ 707.944215] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 708.005342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.005498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.005569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.005789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.010923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.010923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.010923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.010923] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c5f6b39-6381-49b0-a7e7-6087b06083fe is going to be created. [ 708.031301] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5c5f6b39-6381-49b0-a7e7-6087b06083fe], does not exist path=[/infra/domains/default/groups/5c5f6b39-6381-49b0-a7e7-6087b06083fe]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5c5f6b39-6381-49b0-a7e7-6087b06083fe [ 708.031301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c5f6b39-6381-49b0-a7e7-6087b06083fe" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.031301] env[63014]: Traceback (most recent call last): [ 708.031301] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 708.031301] env[63014]: return func(*args, **kwargs) [ 708.031301] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 708.031301] env[63014]: res.raise_for_status() [ 708.031301] env[63014]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 708.031301] env[63014]: raise HTTPError(http_error_msg, response=self) [ 708.031301] env[63014]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5c5f6b39-6381-49b0-a7e7-6087b06083fe [ 708.031301] env[63014]: During handling of the above exception, another exception occurred: [ 708.031301] env[63014]: Traceback (most recent call last): [ 708.031301] env[63014]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 708.031301] env[63014]: listener.cb(fileno) [ 708.031301] env[63014]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 708.031301] env[63014]: result = function(*args, **kwargs) [ 708.031301] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 708.031301] env[63014]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 708.031301] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 708.031301] env[63014]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 708.031301] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 708.031301] env[63014]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 708.031301] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 708.031301] env[63014]: res.raise_for_status() [ 708.031301] env[63014]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 708.031301] env[63014]: raise HTTPError(http_error_msg, response=self) [ 708.031301] env[63014]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5c5f6b39-6381-49b0-a7e7-6087b06083fe [ 708.031301] env[63014]: Removing descriptor: 18 [ 708.721286] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: SUCCESS [ 708.721508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.721672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.721872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.721956] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.224059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.224466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.243995] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: SUCCESS [ 709.244425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.244747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.245139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.245438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.246149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.246149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.246420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.246807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.246910] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.284258] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 709.285789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.286681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.287144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.288736] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.289028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.289180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.289505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.289702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.289873] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.355550] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: SUCCESS [ 709.355952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.356416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.356762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.357036] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.357231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.357355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.357604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.357744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.357876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.358042] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.359013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.359251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.359502] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.359664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.359799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.360205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.360352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.360606] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.470438] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: SUCCESS [ 709.470976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.749756] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.772115] env[63014]: INFO networking_nsxv3.common.synchronization [req-7fdc6383-a98f-436c-83c5-4a494a61aa5c req-f013a839-0156-40ae-98f1-9066ea7bca21 tempest-ServerRescueNegativeTestJSON-1204428609 tempest-ServerRescueNegativeTestJSON-1204428609-project-member] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 709.772115] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 709.772640] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.772757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.772820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.775256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.775447] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.775576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.775663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.778659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.778659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.778659] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.794786] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.862106] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.862366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.862567] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.045356] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.045555] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.045677] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.046232] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.046326] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.046456] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.046804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.046804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.046916] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.047434] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.048190] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.048190] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.048190] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.048439] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 710.049312] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.049510] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.069090] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.069314] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 710.069471] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.069647] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.070798] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.071669] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.071905] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.072282] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.072467] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57982d6d-cd79-48a4-9a7f-9a96cf7ad928',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.253546] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.280808] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.280974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.281045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.281274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.281381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.281613] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.281690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.281722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.281893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.282087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.282087] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc already deleted. [ 710.282236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.298548] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.364812] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.576360] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.580346] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.580494] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.580806] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.580957] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.581137] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 57982d6d-cd79-48a4-9a7f-9a96cf7ad928 not found, creating... [ 710.581432] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.581600] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.581711] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.581961] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.582143] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.583020] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.583020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.583020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.583020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.583224] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.583506] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 57982d6d-cd79-48a4-9a7f-9a96cf7ad928 is going to be created. [ 710.606208] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.608725] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.608725] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.608725] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.608725] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.608725] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.755558] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.755722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.755788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.756009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.756113] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.756233] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc is going to be updated. [ 710.796945] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.796945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.796945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.797371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.797371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.804405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.804405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.804405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.804600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.804600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.806034] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 710.811530] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: IN_PROGRESS for 2s [ 710.855718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.856838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.856838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.858212] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.858375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.868238] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.868398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.868479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.868664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.868739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.868837] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be updated. [ 710.874310] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 710.908639] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.908639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.908639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.908639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.908639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.917908] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: IN_PROGRESS for 2s [ 711.034727] env[63014]: INFO networking_nsxv3.common.synchronization [None req-1cd9cd9a-6160-4467-8ef8-c370aefd395a None None] Enqueued Resource ID: ed43e66a-ed67-404c-87e4-17ec156585bf with Priority: HIGHEST for action port [ 711.035020] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed43e66a-ed67-404c-87e4-17ec156585bf with Priority: HIGHEST for action port [ 711.035568] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed43e66a-ed67-404c-87e4-17ec156585bf taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.035687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed43e66a-ed67-404c-87e4-17ec156585bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.035755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed43e66a-ed67-404c-87e4-17ec156585bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.036033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed43e66a-ed67-404c-87e4-17ec156585bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.036099] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed43e66a-ed67-404c-87e4-17ec156585bf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.435851] env[63014]: INFO networking_nsxv3.common.synchronization [req-7fdc6383-a98f-436c-83c5-4a494a61aa5c req-46efeaca-abe0-47f0-9100-98f1264d2b16 service nova] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_rules [ 711.436105] env[63014]: INFO networking_nsxv3.common.synchronization [req-7fdc6383-a98f-436c-83c5-4a494a61aa5c req-46efeaca-abe0-47f0-9100-98f1264d2b16 service nova] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 711.436177] env[63014]: INFO networking_nsxv3.common.synchronization [req-7fdc6383-a98f-436c-83c5-4a494a61aa5c req-46efeaca-abe0-47f0-9100-98f1264d2b16 service nova] Enqueued Resource ID: 57982d6d-cd79-48a4-9a7f-9a96cf7ad928 with Priority: HIGHEST for action port [ 711.436422] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_rules [ 711.436575] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 711.436814] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57982d6d-cd79-48a4-9a7f-9a96cf7ad928 with Priority: HIGHEST for action port [ 711.437210] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.437331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.437397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.437647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.437745] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.438825] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.438899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.438933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.439193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.439352] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.439465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.439528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.439682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.440114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.440244] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.441516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.441638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.441728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.441915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.442040] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57982d6d-cd79-48a4-9a7f-9a96cf7ad928',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.538621] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed43e66a-ed67-404c-87e4-17ec156585bf [ 711.538858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.539018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.539101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.539288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.539363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.539467] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed43e66a-ed67-404c-87e4-17ec156585bf already deleted. [ 711.539547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed43e66a-ed67-404c-87e4-17ec156585bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.943966] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.945446] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.945446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.945684] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57982d6d-cd79-48a4-9a7f-9a96cf7ad928 with status ACTIVE [ 711.945684] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.945966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.945999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.946344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.946461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.946998] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.947180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.947274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.947527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.947754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.948059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.948473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.948473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.948694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.948866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.949036] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57982d6d-cd79-48a4-9a7f-9a96cf7ad928 is going to be updated. [ 711.994424] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.994584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.994771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.994885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.995019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.995217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57982d6d-cd79-48a4-9a7f-9a96cf7ad928" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.451889] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.754768] env[63014]: INFO networking_nsxv3.common.synchronization [req-51bf4721-d6ac-408c-ae45-d5cf0e2f54f5 req-b49a83d8-cd09-4723-b7be-a95068a03970 tempest-ServerRescueNegativeTestJSON-1204428609 tempest-ServerRescueNegativeTestJSON-1204428609-project-member] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 712.756667] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 712.758660] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.758660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.824731] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: SUCCESS [ 712.825015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.825684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.825684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.825684] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.825684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.825911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.825911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.825970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.826013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.826109] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.884299] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 712.885344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.889040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.889040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.889040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.889040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.889876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.890088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.890258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.890442] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.953575] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: SUCCESS [ 712.953575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.953682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.954648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.954648] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.954648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.954648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.954648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.954648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.954962] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.957907] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.957907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.957907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.957907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.957907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.957907] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc is going to be created. [ 712.987295] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.987295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.987295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.987295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.987295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.003178] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: UNINITIALIZED for 2s [ 713.329529] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.392568] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98c66d04-d431-433a-9b0a-4fec6e74caca: rpc.has_security_group_logging(os_id): False [ 713.413023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.413023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.413023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.413023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.437487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.437487] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.437487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.437487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.437487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.437487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.437487] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.437487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.437487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.437963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.437963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.437963] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.437963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.438144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.438801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.438904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.439112] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 713.461521] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.523672] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.523841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.523921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.524198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.524343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.537109] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 713.584690] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.585031] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.585234] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.585583] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.585885] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.586100] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.586260] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.586527] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.586712] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.587012] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.587101] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.587246] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.587382] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.587526] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 713.587662] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.587831] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.613574] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.613732] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 713.613865] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.614256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.614630] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.614826] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.614989] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.616037] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.616037] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d2a8860-3d0c-43dc-abfd-0da274f39ca0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.698599] env[63014]: INFO networking_nsxv3.common.synchronization [None req-54e30f0a-14d1-4e19-8abb-d905e632f5e9 None None] Enqueued Resource ID: d3e4acf0-af22-4b40-8b15-dd3c6c5077cf with Priority: HIGHEST for action port [ 713.698599] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3e4acf0-af22-4b40-8b15-dd3c6c5077cf with Priority: HIGHEST for action port [ 713.698927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3e4acf0-af22-4b40-8b15-dd3c6c5077cf taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.699056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3e4acf0-af22-4b40-8b15-dd3c6c5077cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.699123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3e4acf0-af22-4b40-8b15-dd3c6c5077cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.699376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3e4acf0-af22-4b40-8b15-dd3c6c5077cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.699456] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3e4acf0-af22-4b40-8b15-dd3c6c5077cf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.831421] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 153c5776-28ea-4b88-b692-fc1ee145e6dc: rpc.has_security_group_logging(os_id): False [ 713.850077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.850077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.850077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.850077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.871050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.871151] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.871241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.871306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.871574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.871727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.871727] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc is going to be updated. [ 713.939696] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.939696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.939696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.939696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.939696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.952948] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: IN_PROGRESS for 2s [ 713.964891] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.119155] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.120020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.120020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.120020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.120438] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.120438] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 3d2a8860-3d0c-43dc-abfd-0da274f39ca0 not found, creating... [ 714.120570] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.120729] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.120843] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.121089] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.121229] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.121506] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.122195] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.122329] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.122598] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.122793] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.123093] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 3d2a8860-3d0c-43dc-abfd-0da274f39ca0 is going to be created. [ 714.158406] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.158926] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.158926] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.159074] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.159564] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.159627] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.201552] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3e4acf0-af22-4b40-8b15-dd3c6c5077cf [ 714.202123] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.202323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.202379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.202661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.202770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.202860] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3e4acf0-af22-4b40-8b15-dd3c6c5077cf already deleted. [ 714.202969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3e4acf0-af22-4b40-8b15-dd3c6c5077cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.468026] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470387] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be updated. [ 714.501027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.501027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.501027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.501027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.501027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.508649] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: IN_PROGRESS for 2s [ 714.853768] env[63014]: INFO networking_nsxv3.common.synchronization [None req-2f9a2fa5-3234-43da-9816-7e13d20c1e69 None None] Enqueued Resource ID: 004300cc-b0e3-44ba-a953-c449fef6ce17 with Priority: HIGHEST for action port [ 714.854352] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004300cc-b0e3-44ba-a953-c449fef6ce17 with Priority: HIGHEST for action port [ 714.855252] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-004300cc-b0e3-44ba-a953-c449fef6ce17 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.855252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-004300cc-b0e3-44ba-a953-c449fef6ce17" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.855252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-004300cc-b0e3-44ba-a953-c449fef6ce17" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.856986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-004300cc-b0e3-44ba-a953-c449fef6ce17" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.857136] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('004300cc-b0e3-44ba-a953-c449fef6ce17',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.015308] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: SUCCESS [ 715.015703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.016358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.016621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.016823] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.016943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.017046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.017244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.017320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.017411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.017510] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.018379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.019726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.019726] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.019726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.019726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.019726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.019726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.019726] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.041201] env[63014]: INFO networking_nsxv3.common.synchronization [req-51bf4721-d6ac-408c-ae45-d5cf0e2f54f5 req-44a46d1f-f3b2-4452-9aff-be0be320f28e service nova] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_rules [ 715.041389] env[63014]: INFO networking_nsxv3.common.synchronization [req-51bf4721-d6ac-408c-ae45-d5cf0e2f54f5 req-44a46d1f-f3b2-4452-9aff-be0be320f28e service nova] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 715.041526] env[63014]: INFO networking_nsxv3.common.synchronization [req-51bf4721-d6ac-408c-ae45-d5cf0e2f54f5 req-44a46d1f-f3b2-4452-9aff-be0be320f28e service nova] Enqueued Resource ID: 3d2a8860-3d0c-43dc-abfd-0da274f39ca0 with Priority: HIGHEST for action port [ 715.042040] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_rules [ 715.042177] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 715.042277] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2a8860-3d0c-43dc-abfd-0da274f39ca0 with Priority: HIGHEST for action port [ 715.042906] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.043011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.049026] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.049026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.049026] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.049026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.049026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.049026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.049026] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d2a8860-3d0c-43dc-abfd-0da274f39ca0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.360609] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 004300cc-b0e3-44ba-a953-c449fef6ce17 [ 715.360885] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.361068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.361141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.361350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.361453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.361551] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:004300cc-b0e3-44ba-a953-c449fef6ce17 already deleted. [ 715.361678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-004300cc-b0e3-44ba-a953-c449fef6ce17" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.496388] env[63014]: INFO networking_nsxv3.common.synchronization [None req-1b3f8a68-9cba-48a0-abd4-249e1fda5138 tempest-ImagesOneServerNegativeTestJSON-1556540069 tempest-ImagesOneServerNegativeTestJSON-1556540069-project-member] Enqueued Resource ID: ef3a154e-5d75-4f36-b240-c9a03821a331 with Priority: HIGHEST for action security_group_rules [ 715.497056] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef3a154e-5d75-4f36-b240-c9a03821a331 with Priority: HIGHEST for action security_group_rules [ 715.497388] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef3a154e-5d75-4f36-b240-c9a03821a331 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.497540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef3a154e-5d75-4f36-b240-c9a03821a331" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.497601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef3a154e-5d75-4f36-b240-c9a03821a331" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.497817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef3a154e-5d75-4f36-b240-c9a03821a331" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.497947] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef3a154e-5d75-4f36-b240-c9a03821a331',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.522029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.522029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.524117] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.549625] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d2a8860-3d0c-43dc-abfd-0da274f39ca0 with status ACTIVE [ 715.549862] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.549995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.550079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.550303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.550394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.550588] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.550688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.550751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.551347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.551347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.551347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.551583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.551583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.551583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.551667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.551731] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d2a8860-3d0c-43dc-abfd-0da274f39ca0 is going to be updated. [ 715.553626] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 715.553825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.554430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.554558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.554659] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.574963] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.575223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.575362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.575626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.575941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.576046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d2a8860-3d0c-43dc-abfd-0da274f39ca0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.635802] env[63014]: INFO networking_nsxv3.common.synchronization [None req-8c83e4ad-196c-4e3a-8b62-9e61838e5940 tempest-ImagesOneServerNegativeTestJSON-1556540069 tempest-ImagesOneServerNegativeTestJSON-1556540069-project-member] Enqueued Resource ID: ef3a154e-5d75-4f36-b240-c9a03821a331 with Priority: HIGHEST for action security_group_rules [ 715.636618] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef3a154e-5d75-4f36-b240-c9a03821a331 with Priority: HIGHEST for action security_group_rules [ 715.636730] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef3a154e-5d75-4f36-b240-c9a03821a331 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.636793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef3a154e-5d75-4f36-b240-c9a03821a331" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.978717] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: SUCCESS [ 715.979049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.021658] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.021658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.021849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.022094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.022260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.022420] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef3a154e-5d75-4f36-b240-c9a03821a331 already deleted. [ 716.022606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef3a154e-5d75-4f36-b240-c9a03821a331" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.022806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef3a154e-5d75-4f36-b240-c9a03821a331" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.023066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef3a154e-5d75-4f36-b240-c9a03821a331" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.023207] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef3a154e-5d75-4f36-b240-c9a03821a331',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.029017] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.059034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.059191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.059300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.059512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.060186] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.060372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.060414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.060550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.060652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.060740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.060897] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.518959] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: SUCCESS [ 716.519325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.519394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.519588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.519777] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.519898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.519951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.520121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.520203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.520292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.520445] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.520536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.520599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.520726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.520866] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.520963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.521020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.521151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.521225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.521372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.521652] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.530563] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.530563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.530563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.530765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.530806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.530924] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc is going to be updated. [ 716.546547] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.546700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.546760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.546941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.548340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.548340] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef3a154e-5d75-4f36-b240-c9a03821a331 already deleted. [ 716.548340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef3a154e-5d75-4f36-b240-c9a03821a331" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.565706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.565706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.565706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.565706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.565706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.566381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.566381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.566381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.566381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.566381] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.567983] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.567983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.567983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.568190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.568222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.598109] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: IN_PROGRESS for 2s [ 717.023534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd5e74f7-45d3-49de-b068-94f50f961f65: rpc.has_security_group_logging(os_id): False [ 717.053227] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.053556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.054419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.054419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.072454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98c66d04-d431-433a-9b0a-4fec6e74caca: rpc.has_security_group_logging(os_id): False [ 717.076904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.078194] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.078351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.078450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.078765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.078886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.079118] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.079275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.079351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.079528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.079630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.079838] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.079957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.080039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.080189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.080267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.080357] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be updated. [ 717.107105] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.107199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.107267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.107470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.107565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.107779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.107912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.108013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.108199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.108273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.108474] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.108557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.108745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.108745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.108800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.109524] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.109642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.109708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.109834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.109902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.109998] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 717.113541] env[63014]: INFO networking_nsxv3.common.synchronization [None req-28f0aee1-828d-4b93-896b-48377c311422 None None] Enqueued Resource ID: 669ede86-efc5-4eb4-bb74-ed6e3cf2e614 with Priority: HIGHEST for action port [ 717.114088] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 669ede86-efc5-4eb4-bb74-ed6e3cf2e614 with Priority: HIGHEST for action port [ 717.114408] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-669ede86-efc5-4eb4-bb74-ed6e3cf2e614 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.114500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-669ede86-efc5-4eb4-bb74-ed6e3cf2e614" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.114558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-669ede86-efc5-4eb4-bb74-ed6e3cf2e614" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.115702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-669ede86-efc5-4eb4-bb74-ed6e3cf2e614" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.115702] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('669ede86-efc5-4eb4-bb74-ed6e3cf2e614',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.157748] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.157748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.157748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.157748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.157748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.179333] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: IN_PROGRESS for 2s [ 717.190415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.190415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.190415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.190415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.190415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.217269] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 717.617376] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 669ede86-efc5-4eb4-bb74-ed6e3cf2e614 [ 717.617376] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.617715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.617715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.617715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.617878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.617908] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:669ede86-efc5-4eb4-bb74-ed6e3cf2e614 already deleted. [ 717.618120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-669ede86-efc5-4eb4-bb74-ed6e3cf2e614" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.031113] env[63014]: INFO networking_nsxv3.common.synchronization [req-5da9f176-1bb9-4622-9e45-6df384e5a6a7 req-693f9af6-49b1-4603-9018-db9b911fab0f tempest-ServerRescueTestJSONUnderV235-324280675 tempest-ServerRescueTestJSONUnderV235-324280675-project-member] Enqueued Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 718.031631] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd5e74f7-45d3-49de-b068-94f50f961f65 with Priority: HIGHEST for action security_group_members [ 718.031952] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd5e74f7-45d3-49de-b068-94f50f961f65 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.032132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.032864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.033268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.033447] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.033621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.033730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.033976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.034121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.034290] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.312065] env[63014]: INFO networking_nsxv3.common.synchronization [req-4700fd2a-ac86-4dc0-8cfe-d7ede0e5c5e5 req-feb2db0c-e69f-4351-bc77-9eb04d3e2a2b tempest-AttachInterfacesV270Test-1569833341 tempest-AttachInterfacesV270Test-1569833341-project-member] Enqueued Resource ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a with Priority: HIGHEST for action security_group_members [ 718.312614] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a with Priority: HIGHEST for action security_group_members [ 718.312924] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.313088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.313905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.313905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.313905] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.313905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.314122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.314809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.314909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.315037] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ab84161a-cc47-4bb7-8bc3-f695a8be1c0a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.536325] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.536576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.536576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.536782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.536873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.537086] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.537209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.537264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.537393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.537466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.537556] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be updated. [ 718.563975] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.564197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.564275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.564488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.564638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.573331] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: IN_PROGRESS for 2s [ 718.606302] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: SUCCESS [ 718.606541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.607176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.607176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.607176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.607380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.607380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.607499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.607603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.607711] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.820095] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.820442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.820442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.820767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.842222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.842390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.843042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.843042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.843042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.843042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.843042] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a is going to be updated. [ 718.867987] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.868189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.868231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.868434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.868571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.876407] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a in Status: IN_PROGRESS for 2s [ 719.111068] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.192777] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: SUCCESS [ 719.193043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.193234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.193530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.193630] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd5e74f7-45d3-49de-b068-94f50f961f65',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.230276] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 719.230484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.614477] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.717694] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.717853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.717903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.719056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.719056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.719168] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 is going to be deleted. [ 719.776531] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.776531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.776531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.776531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.776531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.776531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.115723] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.116112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.116112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.118372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.118372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.118372] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc is going to be updated. [ 720.146512] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.146638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.146675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.146987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.147070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.155685] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: IN_PROGRESS for 2s [ 720.591388] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: IN_PROGRESS for 4s [ 720.888459] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a in Status: SUCCESS [ 720.888652] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ab84161a-cc47-4bb7-8bc3-f695a8be1c0a deletion is rescheduled due to dependency. [ 720.888768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ab84161a-cc47-4bb7-8bc3-f695a8be1c0a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.499023] env[63014]: INFO networking_nsxv3.common.synchronization [req-c6cf4f0d-ad41-4054-87f2-783fb63b94f4 req-a9e39ca8-06b5-4ef3-a0c3-841b756e17b9 tempest-ServersTestFqdnHostnames-1394113230 tempest-ServersTestFqdnHostnames-1394113230-project-member] Enqueued Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_members [ 721.499023] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGHEST for action security_group_members [ 721.499023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-efd91700-654d-4bc1-8b27-185db0eb3543 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.499023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.499023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.499023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.499023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.499023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.499023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.499023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.499023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.499023] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.001814] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.002029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.002119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.002328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.037727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.039023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.039023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.039023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.039023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.039023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.039023] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd91700-654d-4bc1-8b27-185db0eb3543 is going to be updated. [ 722.076450] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.076450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.076450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.076450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.076450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.089014] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd91700-654d-4bc1-8b27-185db0eb3543 in Status: IN_PROGRESS for 2s [ 722.156927] env[63014]: INFO networking_nsxv3.common.synchronization [req-3204cbb6-7bf1-44c4-8089-de6048853926 req-4085a41c-410a-42d8-90fc-3839ebaa1f1f tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 722.156927] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 722.156927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.156927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.156927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.156927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.156927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.157485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.157485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.157485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.157485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.157485] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.169700] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: SUCCESS [ 722.170474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.170474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.170474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.170474] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.170756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.170756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.170756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.170878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.170878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.171057] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.171873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.171873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.171873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.171873] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.171873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.171873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.173664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.173664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.173664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.173664] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.503102] env[63014]: INFO networking_nsxv3.common.synchronization [req-2cddf1ed-56b2-4686-8d37-79ad59ca41ff req-333283cf-789c-428f-8e92-b7e8c4a9fa80 tempest-ServersAdminTestJSON-1268263957 tempest-ServersAdminTestJSON-1268263957-project-member] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 722.503639] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 722.507023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.507023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.507023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.507023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.507023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.507023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.507023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.507023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.507023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.507023] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.601570] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd5e74f7-45d3-49de-b068-94f50f961f65 in Status: SUCCESS [ 722.601570] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd5e74f7-45d3-49de-b068-94f50f961f65 deletion is rescheduled due to dependency. [ 722.601570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd5e74f7-45d3-49de-b068-94f50f961f65" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.665522] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.665522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.665522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.665522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.679830] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 619cffb4-27cb-425f-bcd2-3f3b163886dc: rpc.has_security_group_logging(os_id): False [ 722.684273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.684705] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.686608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.686608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.686608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.686608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.686608] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a is going to be updated. [ 722.700023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.700023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.700023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.700023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.700656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.700656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.700656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.700656] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.700656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.700881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.700881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.700969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.700969] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc is going to be created. [ 722.722018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.722018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.722018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.722018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.722018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.732145] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: IN_PROGRESS for 2s [ 722.774382] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.774523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.774591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.774801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.775056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.787239] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: IN_PROGRESS for 2s [ 723.007569] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.511580] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.015728] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.016591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.017710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.017964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.019068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.019068] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 724.050520] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.050636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.050708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.051038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.051152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.061490] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 724.098450] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: efd91700-654d-4bc1-8b27-185db0eb3543 in Status: SUCCESS [ 724.098637] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: efd91700-654d-4bc1-8b27-185db0eb3543 deletion is rescheduled due to dependency. [ 724.098854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.390809] env[63014]: INFO networking_nsxv3.common.synchronization [None req-b1c11e38-7003-44ac-9837-fa5fe5b37337 None None] Enqueued Resource ID: 457b9aba-91dd-4d7f-b935-14c3d126e2d2 with Priority: HIGHEST for action port [ 724.391112] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 457b9aba-91dd-4d7f-b935-14c3d126e2d2 with Priority: HIGHEST for action port [ 724.391705] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-457b9aba-91dd-4d7f-b935-14c3d126e2d2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.391881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-457b9aba-91dd-4d7f-b935-14c3d126e2d2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.391995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-457b9aba-91dd-4d7f-b935-14c3d126e2d2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.392243] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-457b9aba-91dd-4d7f-b935-14c3d126e2d2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.392834] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('457b9aba-91dd-4d7f-b935-14c3d126e2d2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.741633] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: SUCCESS [ 724.741930] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a deletion is rescheduled due to dependency. [ 724.741930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.803339] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: SUCCESS [ 724.803575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.803753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.803983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.804107] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.895417] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 457b9aba-91dd-4d7f-b935-14c3d126e2d2 [ 724.895675] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.895810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.895879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.896120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.896216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.896313] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:457b9aba-91dd-4d7f-b935-14c3d126e2d2 already deleted. [ 724.896395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-457b9aba-91dd-4d7f-b935-14c3d126e2d2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.242570] env[63014]: INFO networking_nsxv3.common.synchronization [req-0b0813d5-fe6e-46d0-a4e7-7f40cc5457f9 req-b349c09e-6f77-4943-b4fc-93061a7a5d8a tempest-ServersTestManualDisk-740044999 tempest-ServersTestManualDisk-740044999-project-member] Enqueued Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_members [ 725.243045] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGHEST for action security_group_members [ 725.243663] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.243663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.243663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.243822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.244145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.244145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.244311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.244882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.244882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.244882] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.308927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.308927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.308927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.308927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.308927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.308927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.308927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.308927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.308927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.308927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.308927] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.751258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.751258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.751258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.751258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.775719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.775990] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.776120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.776188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.776395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.776476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.776568] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 is going to be updated. [ 725.806694] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.806694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.806694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.806694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.806694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.811655] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.811655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.811890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.811890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.812524] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.812524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.812524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.812524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.812524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.812524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.812742] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.812742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.812818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.812920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.813551] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.813551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.813551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.813551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.813551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.813551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.813551] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.815506] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 in Status: IN_PROGRESS for 2s [ 726.072414] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 726.072414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.316608] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 619cffb4-27cb-425f-bcd2-3f3b163886dc: rpc.has_security_group_logging(os_id): False [ 726.419725] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.419957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.419957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.420218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.420317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.420537] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.420640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.420704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.420855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.420931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.421122] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.421217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.421339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.421425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.421498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.421685] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.421777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.421837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.421995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.422082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.422169] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc is going to be updated. [ 726.488452] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.488452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.488452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.488452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.488452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.501885] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: IN_PROGRESS for 2s [ 727.825052] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 in Status: SUCCESS [ 727.825406] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 deletion is rescheduled due to dependency. [ 727.825869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.517943] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: SUCCESS [ 728.517943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.976517] env[63014]: INFO networking_nsxv3.common.synchronization [None req-11af1a70-6414-46b7-90ee-044817bd4c20 None None] Enqueued Resource ID: 64917e34-2cf4-44e8-83a7-dd8458df5229 with Priority: HIGHEST for action port [ 729.976791] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64917e34-2cf4-44e8-83a7-dd8458df5229 with Priority: HIGHEST for action port [ 729.977360] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-64917e34-2cf4-44e8-83a7-dd8458df5229 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.977479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64917e34-2cf4-44e8-83a7-dd8458df5229" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.977542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64917e34-2cf4-44e8-83a7-dd8458df5229" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.977789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64917e34-2cf4-44e8-83a7-dd8458df5229" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.977864] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64917e34-2cf4-44e8-83a7-dd8458df5229',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.479542] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64917e34-2cf4-44e8-83a7-dd8458df5229 [ 730.481235] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.481235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.481235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.481235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.481235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481235] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64917e34-2cf4-44e8-83a7-dd8458df5229 already deleted. [ 730.481235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64917e34-2cf4-44e8-83a7-dd8458df5229" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.112533] env[63014]: INFO networking_nsxv3.common.synchronization [None req-147ec3dd-98e0-49a6-829e-ad456ef36cd6 None None] Enqueued Resource ID: 6b3b1ee4-40be-4fee-817c-3c2196cf18a6 with Priority: HIGHEST for action port [ 732.112798] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b3b1ee4-40be-4fee-817c-3c2196cf18a6 with Priority: HIGHEST for action port [ 732.113446] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b3b1ee4-40be-4fee-817c-3c2196cf18a6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.113563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b3b1ee4-40be-4fee-817c-3c2196cf18a6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.113631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b3b1ee4-40be-4fee-817c-3c2196cf18a6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.114076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b3b1ee4-40be-4fee-817c-3c2196cf18a6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.114475] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b3b1ee4-40be-4fee-817c-3c2196cf18a6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.618382] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b3b1ee4-40be-4fee-817c-3c2196cf18a6 [ 732.618624] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.618754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.618825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.619067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.619165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.619267] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b3b1ee4-40be-4fee-817c-3c2196cf18a6 already deleted. [ 732.619348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b3b1ee4-40be-4fee-817c-3c2196cf18a6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.560308] env[63014]: INFO networking_nsxv3.common.synchronization [req-613c1cd1-d9fd-4120-a8a8-954f15134286 req-ce85ad48-7958-4203-a472-47c11ce099fa tempest-ListImageFiltersTestJSON-1238518118 tempest-ListImageFiltersTestJSON-1238518118-project-member] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 734.560826] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 734.561170] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.561307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.561376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.561660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.561784] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.561890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.561979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.562185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.566020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.566020] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.058886] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.059397] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.059593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.060418] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.060418] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.060711] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.060887] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.061174] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.061388] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.061684] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.061930] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.062130] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.062370] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.062551] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 735.066027] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.066027] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.066027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.066027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.066027] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 already deleted. [ 735.066027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.091250] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.091250] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 735.091250] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.091250] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.091250] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-8a84455e-e371-4071-ac15-add8f29e1430 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.091517] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-8a84455e-e371-4071-ac15-add8f29e1430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.091517] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-8a84455e-e371-4071-ac15-add8f29e1430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.091725] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-8a84455e-e371-4071-ac15-add8f29e1430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.091859] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a84455e-e371-4071-ac15-add8f29e1430',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.595772] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.596193] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.596503] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.596917] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.597203] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.597461] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 8a84455e-e371-4071-ac15-add8f29e1430 not found, creating... [ 735.597887] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.598166] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.598369] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.599030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.599030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.600032] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.600224] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.600289] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.600546] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.600694] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.600843] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 8a84455e-e371-4071-ac15-add8f29e1430 is going to be created. [ 735.624040] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.624040] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.624040] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.624040] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.624040] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.624040] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-8a84455e-e371-4071-ac15-add8f29e1430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.715647] env[63014]: INFO networking_nsxv3.common.synchronization [req-613c1cd1-d9fd-4120-a8a8-954f15134286 req-63597294-f493-4f1a-a356-c7505596ea88 service nova] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_rules [ 736.715647] env[63014]: INFO networking_nsxv3.common.synchronization [req-613c1cd1-d9fd-4120-a8a8-954f15134286 req-63597294-f493-4f1a-a356-c7505596ea88 service nova] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 736.715647] env[63014]: INFO networking_nsxv3.common.synchronization [req-613c1cd1-d9fd-4120-a8a8-954f15134286 req-63597294-f493-4f1a-a356-c7505596ea88 service nova] Enqueued Resource ID: 8a84455e-e371-4071-ac15-add8f29e1430 with Priority: HIGHEST for action port [ 736.715647] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_rules [ 736.715647] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 736.715647] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a84455e-e371-4071-ac15-add8f29e1430 with Priority: HIGHEST for action port [ 736.716093] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.716093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.716093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.716320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.716368] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.718597] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.718671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.718784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.718917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.719655] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.719655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.719655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.719655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.719655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.719655] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.721587] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a84455e-e371-4071-ac15-add8f29e1430 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.721587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a84455e-e371-4071-ac15-add8f29e1430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.721587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a84455e-e371-4071-ac15-add8f29e1430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.721744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a84455e-e371-4071-ac15-add8f29e1430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.721808] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a84455e-e371-4071-ac15-add8f29e1430',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.223959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.223959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.224360] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.225014] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a84455e-e371-4071-ac15-add8f29e1430 with status ACTIVE [ 737.225234] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.225370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.225436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.225647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.225739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.225913] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.226015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.226078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.226226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.226310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.226498] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.226581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.226631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.226777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.226852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.226990] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a84455e-e371-4071-ac15-add8f29e1430 is going to be updated. [ 737.248979] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.249209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.249209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.249437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.249534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.249671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a84455e-e371-4071-ac15-add8f29e1430" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.678910] env[63014]: INFO networking_nsxv3.common.synchronization [None req-e65fcb4d-8371-4c7e-84f2-84d42ffb6c63 tempest-MigrationsAdminTest-518512597 tempest-MigrationsAdminTest-518512597-project-member] Enqueued Resource ID: a08378bd-b8c5-49dc-910a-8ab738dcc7f6 with Priority: HIGHEST for action security_group_rules [ 737.678910] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08378bd-b8c5-49dc-910a-8ab738dcc7f6 with Priority: HIGHEST for action security_group_rules [ 737.678910] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.678910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.678910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.678910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.678910] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a08378bd-b8c5-49dc-910a-8ab738dcc7f6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.729290] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.899381] env[63014]: INFO networking_nsxv3.common.synchronization [None req-a5c182e5-3de8-49c9-b985-7998253ecd50 tempest-MigrationsAdminTest-518512597 tempest-MigrationsAdminTest-518512597-project-member] Enqueued Resource ID: a08378bd-b8c5-49dc-910a-8ab738dcc7f6 with Priority: HIGHEST for action security_group_rules [ 737.899903] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a08378bd-b8c5-49dc-910a-8ab738dcc7f6 with Priority: HIGHEST for action security_group_rules [ 737.900215] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.900314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.198636] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.198985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.198985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.199200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.199352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.199924] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a08378bd-b8c5-49dc-910a-8ab738dcc7f6 already deleted. [ 738.199924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.199924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.200228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.200228] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a08378bd-b8c5-49dc-910a-8ab738dcc7f6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.231977] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.232232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.232232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.232724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.232724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.232884] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 is going to be created. [ 738.259378] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.259378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.259671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.259671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.259846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.270757] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: UNINITIALIZED for 2s [ 738.729237] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.729237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.729237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.729237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.729237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.729237] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a08378bd-b8c5-49dc-910a-8ab738dcc7f6 already deleted. [ 738.729237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a08378bd-b8c5-49dc-910a-8ab738dcc7f6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.281570] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: SUCCESS [ 740.281947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.281947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.282965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.282965] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.282965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.282965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.283259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.283259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.283349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.283415] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.785834] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.786014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.786098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.786334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.786513] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.786635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.786704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.786898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.786992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.787104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.787815] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.787928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.787996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.788210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.788404] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.788514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.788578] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.788728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.788811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788981] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.294618] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c9b8f59-0fe1-4382-ad8c-018641195651: rpc.has_security_group_logging(os_id): False [ 741.316027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.316187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.316187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.316476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.316476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.316668] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.316768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.316855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.316972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.317059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.317239] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.317329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.317417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.317522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.317596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.317779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.317869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.317966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.318101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.318187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.318259] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 is going to be created. [ 741.392201] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.392390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.392479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.392633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.392893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.411975] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: IN_PROGRESS for 2s [ 742.702163] env[63014]: INFO networking_nsxv3.common.synchronization [req-e453404c-1b91-4a4a-833d-43e3107d9f59 req-e113be84-eb53-4af0-9c68-eba52867e841 tempest-ListImageFiltersTestJSON-1238518118 tempest-ListImageFiltersTestJSON-1238518118-project-member] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 742.702163] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 742.702163] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.702163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.702607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.702607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.702607] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.702713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.702713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.703238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.703378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.704477] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.206997] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.289257] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.289257] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.289257] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.289257] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.289257] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.289257] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.289257] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.290045] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.290346] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.290825] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.291091] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 743.291330] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 743.291569] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 743.291812] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 743.292218] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 743.292500] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 743.313954] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 743.313954] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 743.313954] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 743.313954] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.313954] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-39e53b04-d70e-4e42-80ee-483b6e22d29c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.313954] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-39e53b04-d70e-4e42-80ee-483b6e22d29c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.313954] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-39e53b04-d70e-4e42-80ee-483b6e22d29c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.313954] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-39e53b04-d70e-4e42-80ee-483b6e22d29c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.313954] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39e53b04-d70e-4e42-80ee-483b6e22d29c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.427527] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: SUCCESS [ 743.427778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.713914] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.817148] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.817378] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.817512] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.817803] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.817961] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.818136] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 39e53b04-d70e-4e42-80ee-483b6e22d29c not found, creating... [ 743.818406] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.818563] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.818681] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.818899] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.819052] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.819341] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.819496] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.819624] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.819820] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.819982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.820110] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 39e53b04-d70e-4e42-80ee-483b6e22d29c is going to be created. [ 743.843844] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.844135] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.844301] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.844649] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.844938] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.845225] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-39e53b04-d70e-4e42-80ee-483b6e22d29c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.221018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.221211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.221303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.221570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.221670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.221930] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 is going to be updated. [ 744.253323] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.253855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.253855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.253978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.254263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.263778] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: IN_PROGRESS for 2s [ 744.683205] env[63014]: INFO networking_nsxv3.common.synchronization [req-e453404c-1b91-4a4a-833d-43e3107d9f59 req-01ef7c71-b974-4f94-b63b-0fa1c419fd0e service nova] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_rules [ 744.683386] env[63014]: INFO networking_nsxv3.common.synchronization [req-e453404c-1b91-4a4a-833d-43e3107d9f59 req-01ef7c71-b974-4f94-b63b-0fa1c419fd0e service nova] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 744.683530] env[63014]: INFO networking_nsxv3.common.synchronization [req-e453404c-1b91-4a4a-833d-43e3107d9f59 req-01ef7c71-b974-4f94-b63b-0fa1c419fd0e service nova] Enqueued Resource ID: 39e53b04-d70e-4e42-80ee-483b6e22d29c with Priority: HIGHEST for action port [ 744.683759] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_rules [ 744.683889] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 744.683983] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39e53b04-d70e-4e42-80ee-483b6e22d29c with Priority: HIGHEST for action port [ 744.684613] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.684739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.684806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.685111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.685226] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.686145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.686218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.686457] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-39e53b04-d70e-4e42-80ee-483b6e22d29c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.686586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39e53b04-d70e-4e42-80ee-483b6e22d29c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.686655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39e53b04-d70e-4e42-80ee-483b6e22d29c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.686857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39e53b04-d70e-4e42-80ee-483b6e22d29c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.686933] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39e53b04-d70e-4e42-80ee-483b6e22d29c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.188560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.188989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.188989] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39e53b04-d70e-4e42-80ee-483b6e22d29c with status ACTIVE [ 745.189397] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.189397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.189397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.189525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.189680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.189764] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.189851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.189913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.190137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.190191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.190427] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.190484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.190484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.190654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.190866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.190866] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39e53b04-d70e-4e42-80ee-483b6e22d29c is going to be updated. [ 745.218504] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.218761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.218761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.218957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.219124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.219301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39e53b04-d70e-4e42-80ee-483b6e22d29c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.273848] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: SUCCESS [ 746.274178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.274344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.274634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.274811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.274911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.274911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.275074] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.275263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.275263] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.313018] env[63014]: INFO networking_nsxv3.common.synchronization [req-9a330e75-759a-47f4-8950-c814e7abe82e req-f5d48610-0781-4f50-833f-5f40b11a8d41 tempest-ServerGroupTestJSON-1752232908 tempest-ServerGroupTestJSON-1752232908-project-member] Enqueued Resource ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b with Priority: HIGHEST for action security_group_members [ 746.313018] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b with Priority: HIGHEST for action security_group_members [ 746.313018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-24d80c6b-3ebf-4ee6-8524-63b081da521b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.313018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.313018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.313018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.313349] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.313349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.313349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.313458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.314543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.314543] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24d80c6b-3ebf-4ee6-8524-63b081da521b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.637236] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-97 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.637412] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-97" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.637517] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-97" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.637865] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-97" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.638142] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.638303] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.638425] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.638670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.638817] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.639038] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.639157] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.639266] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.639375] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.639484] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 746.639589] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.639720] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.659868] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.660100] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 746.660301] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.660548] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-97" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.660973] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.661227] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.661414] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.661859] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.662477] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22abf6a6-e0db-4cd8-b56c-fec023a97f4d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.779481] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.816933] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.817116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.817191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.817751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.817896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.818213] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.818213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.818356] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.818437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.818515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.818598] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b already deleted. [ 746.818681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.164696] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.164915] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.165077] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.165368] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.165522] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.165678] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 22abf6a6-e0db-4cd8-b56c-fec023a97f4d not found, creating... [ 747.165951] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.166131] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.166681] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.166992] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.167182] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.169525] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.169525] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.169525] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.169525] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.169525] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.169525] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 22abf6a6-e0db-4cd8-b56c-fec023a97f4d is going to be created. [ 747.215807] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.216126] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.216362] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.216730] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.216730] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.216934] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.281733] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.786349] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.786349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.786349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.786349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.786349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.786349] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 is going to be updated. [ 747.819451] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.819451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.819451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.819451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.820099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.830206] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: IN_PROGRESS for 2s [ 747.916577] env[63014]: INFO networking_nsxv3.common.synchronization [req-9a330e75-759a-47f4-8950-c814e7abe82e req-9ce1cc08-649c-4eeb-9c98-2ffaf3d1408e service nova] Enqueued Resource ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b with Priority: HIGHEST for action security_group_rules [ 747.916718] env[63014]: INFO networking_nsxv3.common.synchronization [req-9a330e75-759a-47f4-8950-c814e7abe82e req-9ce1cc08-649c-4eeb-9c98-2ffaf3d1408e service nova] Enqueued Resource ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b with Priority: HIGHEST for action security_group_members [ 747.917032] env[63014]: INFO networking_nsxv3.common.synchronization [req-9a330e75-759a-47f4-8950-c814e7abe82e req-9ce1cc08-649c-4eeb-9c98-2ffaf3d1408e service nova] Enqueued Resource ID: 22abf6a6-e0db-4cd8-b56c-fec023a97f4d with Priority: HIGHEST for action port [ 747.917530] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b with Priority: HIGHEST for action security_group_rules [ 747.919130] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b with Priority: HIGHEST for action security_group_members [ 747.919130] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22abf6a6-e0db-4cd8-b56c-fec023a97f4d with Priority: HIGHEST for action port [ 747.919130] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24d80c6b-3ebf-4ee6-8524-63b081da521b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.919130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.919130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.919130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.919496] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24d80c6b-3ebf-4ee6-8524-63b081da521b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.920979] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-24d80c6b-3ebf-4ee6-8524-63b081da521b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.921265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.924036] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.924036] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24d80c6b-3ebf-4ee6-8524-63b081da521b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.924036] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.924036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.924036] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22abf6a6-e0db-4cd8-b56c-fec023a97f4d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.005513] env[63014]: INFO networking_nsxv3.common.synchronization [req-d17528d0-e396-4b3b-9239-af57bf9070f6 req-45e6c762-1928-4874-bd4e-84fbe6d9ef29 tempest-ServerActionsV293TestJSON-1713986573 tempest-ServerActionsV293TestJSON-1713986573-project-member] Enqueued Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_members [ 748.005513] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_members [ 748.005806] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf011c-cc1f-4e0b-b169-b433df9cce25 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.005929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.005997] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.006640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.007191] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.008913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.008913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.008913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.008913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.008913] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.421787] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-24d80c6b-3ebf-4ee6-8524-63b081da521b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.421787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.431019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22abf6a6-e0db-4cd8-b56c-fec023a97f4d with status ACTIVE [ 748.431019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.431019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.431019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.431019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.431019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22abf6a6-e0db-4cd8-b56c-fec023a97f4d is going to be updated. [ 748.431602] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24d80c6b-3ebf-4ee6-8524-63b081da521b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.446304] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-611 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.448026] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.448026] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.448026] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.448026] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.448026] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.448026] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.448026] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.448026] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.450800] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.450800] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.450800] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.450800] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.450800] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 748.450800] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.450800] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.452390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.452767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.452984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.453397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.453682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.453951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22abf6a6-e0db-4cd8-b56c-fec023a97f4d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.472314] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.472648] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 748.473134] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.475191] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-611" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.475191] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-dc6d6188-266e-42cd-a4b7-ca1651674767 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.475191] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-dc6d6188-266e-42cd-a4b7-ca1651674767" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.475191] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-dc6d6188-266e-42cd-a4b7-ca1651674767" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.475191] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-dc6d6188-266e-42cd-a4b7-ca1651674767" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.475191] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc6d6188-266e-42cd-a4b7-ca1651674767',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.511830] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.511830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.511830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.511955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.512057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.512725] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.512725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.512725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.512725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.512725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.513195] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 already deleted. [ 748.513195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.933930] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24d80c6b-3ebf-4ee6-8524-63b081da521b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.982340] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.982678] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.982859] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.983233] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.983534] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.983611] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port dc6d6188-266e-42cd-a4b7-ca1651674767 not found, creating... [ 748.983909] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.984209] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.984448] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.984690] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.984837] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.985202] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.985359] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.985479] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.985696] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.985836] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.985979] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: dc6d6188-266e-42cd-a4b7-ca1651674767 is going to be created. [ 749.005591] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.005739] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.005860] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.006119] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.006343] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.006560] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-dc6d6188-266e-42cd-a4b7-ca1651674767" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.438411] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.438740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.438740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.438976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.439059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.439119] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b is going to be created. [ 749.471294] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.471466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.471505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.471732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.471898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.485021] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b in Status: UNINITIALIZED for 2s [ 749.841338] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: SUCCESS [ 749.842597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.842874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.843041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.843244] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.843411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.843456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.843594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.843674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.843757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.843846] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.960034] env[63014]: INFO networking_nsxv3.common.synchronization [req-d17528d0-e396-4b3b-9239-af57bf9070f6 req-efd73ba6-1c21-4978-8f25-25e88b1dc0d4 service nova] Enqueued Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_rules [ 749.960252] env[63014]: INFO networking_nsxv3.common.synchronization [req-d17528d0-e396-4b3b-9239-af57bf9070f6 req-efd73ba6-1c21-4978-8f25-25e88b1dc0d4 service nova] Enqueued Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_members [ 749.960394] env[63014]: INFO networking_nsxv3.common.synchronization [req-d17528d0-e396-4b3b-9239-af57bf9070f6 req-efd73ba6-1c21-4978-8f25-25e88b1dc0d4 service nova] Enqueued Resource ID: dc6d6188-266e-42cd-a4b7-ca1651674767 with Priority: HIGHEST for action port [ 749.961216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_rules [ 749.961216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_members [ 749.961216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc6d6188-266e-42cd-a4b7-ca1651674767 with Priority: HIGHEST for action port [ 749.964870] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.965018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.965116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.965339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.965423] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.966651] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf011c-cc1f-4e0b-b169-b433df9cce25 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.966716] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.966759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.968024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.968024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.968024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.968024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.968024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.968024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.968024] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.968604] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc6d6188-266e-42cd-a4b7-ca1651674767 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.968604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc6d6188-266e-42cd-a4b7-ca1651674767" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.968604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc6d6188-266e-42cd-a4b7-ca1651674767" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.968604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc6d6188-266e-42cd-a4b7-ca1651674767" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.968776] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc6d6188-266e-42cd-a4b7-ca1651674767',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.995665] env[63014]: INFO networking_nsxv3.common.synchronization [None req-3323d66f-1c3d-4418-9f50-3d75de5c5c1c tempest-ServerRescueNegativeTestJSON-1204428609 tempest-ServerRescueNegativeTestJSON-1204428609-project-member] Enqueued Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_rules [ 749.996123] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_rules [ 749.996445] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b799ddde-e254-4e10-850e-ade205a5fd9b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.996688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.996688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.996893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.997418] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.093155] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ade049f2-72c7-479e-869a-9938886fb591 tempest-ServerRescueNegativeTestJSON-1204428609 tempest-ServerRescueNegativeTestJSON-1204428609-project-member] Enqueued Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_rules [ 750.093705] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_rules [ 750.094025] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b799ddde-e254-4e10-850e-ade205a5fd9b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.094195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.348949] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.348949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.348949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.348949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.348949] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.349704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.349869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.350118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.350515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.350707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.351966] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.352145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.352199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.352722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.352722] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.352722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.352722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.352888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.352888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.352974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.353130] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.470940] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.472398] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf011c-cc1f-4e0b-b169-b433df9cce25 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.472398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.474516] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc6d6188-266e-42cd-a4b7-ca1651674767 with status ACTIVE [ 750.474737] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.475029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.475029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.475765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.475765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.475765] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.475765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.475765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.475999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.475999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.476073] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.476200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.476250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.476353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.476423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.478808] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc6d6188-266e-42cd-a4b7-ca1651674767 is going to be updated. [ 750.518642] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.518780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.518780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.518988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.519143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.519311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc6d6188-266e-42cd-a4b7-ca1651674767" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.520209] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.520317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.520387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.520559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.520753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.520753] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b799ddde-e254-4e10-850e-ade205a5fd9b already deleted. [ 750.520844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.520988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.521189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.521280] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.764124] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 750.764268] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent loop - iteration:1 started [ 750.859179] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c9b8f59-0fe1-4382-ad8c-018641195651: rpc.has_security_group_logging(os_id): False [ 750.876705] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.876865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.876865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.877053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.877145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.877331] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.877420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.877476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.877622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.877697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.877874] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.877961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.878029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.878198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.878274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.878467] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.878549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.878610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.878746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.878816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.878896] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 is going to be updated. [ 750.938166] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.938320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.938381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.938617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.938723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.954569] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: IN_PROGRESS for 2s [ 750.975076] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.061139] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.061139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.061139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.061139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.061139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.061139] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b799ddde-e254-4e10-850e-ade205a5fd9b already deleted. [ 751.061139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.283616] env[63014]: INFO networking_nsxv3.common.synchronization [req-797ea50e-da1b-469a-a5a3-de84bc07ce6f req-adc9655a-7335-4e77-88e7-2953b6d505b8 tempest-ServersAdminNegativeTestJSON-817582727 tempest-ServersAdminNegativeTestJSON-817582727-project-member] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 751.284184] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 751.284515] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.284724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.284724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.284897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.287259] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.287398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.287470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.287665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.287760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.287855] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.479927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.480415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.480415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.480415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.480725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.480725] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 is going to be created. [ 751.500828] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b in Status: SUCCESS [ 751.503316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.503316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.503316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.503316] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.503316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.503316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.503316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.503316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.503316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.503316] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24d80c6b-3ebf-4ee6-8524-63b081da521b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.507506] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.508037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.508273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.508606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.511025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.521669] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 in Status: UNINITIALIZED for 2s [ 751.790432] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.848854] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.849362] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.850036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.850036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.850283] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.850724] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.850724] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.854021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.854021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.854021] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.854021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.854021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.854021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.854021] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 751.854021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.854021] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.871022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.871108] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 751.871207] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.871375] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.871688] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-acdf88b0-772b-4bfa-9bac-e0773934c81c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.871857] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-acdf88b0-772b-4bfa-9bac-e0773934c81c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.872183] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-acdf88b0-772b-4bfa-9bac-e0773934c81c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.872571] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-acdf88b0-772b-4bfa-9bac-e0773934c81c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.872867] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acdf88b0-772b-4bfa-9bac-e0773934c81c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.008901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-24d80c6b-3ebf-4ee6-8524-63b081da521b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.009083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.009163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.009390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.009566] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.009665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.009730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.009876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.009969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.010070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.010223] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-24d80c6b-3ebf-4ee6-8524-63b081da521b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.010312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.010373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.010516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.010649] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.010778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.010849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.010994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.011085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.011168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.011256] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24d80c6b-3ebf-4ee6-8524-63b081da521b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.292697] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.376025] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.376291] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.376995] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.376995] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.376995] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.378775] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port acdf88b0-772b-4bfa-9bac-e0773934c81c not found, creating... [ 752.379186] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.379386] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.379589] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.379935] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.380824] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.381595] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.381702] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.381928] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.382293] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.382524] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.382811] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: acdf88b0-772b-4bfa-9bac-e0773934c81c is going to be created. [ 752.408928] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.408928] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.409599] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.409997] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.410260] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.410520] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-acdf88b0-772b-4bfa-9bac-e0773934c81c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.514346] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24d80c6b-3ebf-4ee6-8524-63b081da521b: rpc.has_security_group_logging(os_id): False [ 752.564800] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.564989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.565131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.565391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.566138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.566391] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.566571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.566700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.567234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.567542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.567804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.568754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.568754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.568754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.568754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.570395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.570395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.570395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.570395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.570575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.570621] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b is going to be created. [ 752.644861] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.645069] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.645155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.645447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.645653] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.661374] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b in Status: IN_PROGRESS for 2s [ 752.797756] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.798771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.798771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.798771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.798771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.798771] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb is going to be updated. [ 752.864629] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.864629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.864629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.864629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.864629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.872737] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: IN_PROGRESS for 2s [ 752.969591] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: SUCCESS [ 752.971193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.291952] env[63014]: INFO networking_nsxv3.common.synchronization [req-797ea50e-da1b-469a-a5a3-de84bc07ce6f req-b9b2ae89-9744-4c8e-b905-a6856c8be51e service nova] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_rules [ 753.291952] env[63014]: INFO networking_nsxv3.common.synchronization [req-797ea50e-da1b-469a-a5a3-de84bc07ce6f req-b9b2ae89-9744-4c8e-b905-a6856c8be51e service nova] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 753.291952] env[63014]: INFO networking_nsxv3.common.synchronization [req-797ea50e-da1b-469a-a5a3-de84bc07ce6f req-b9b2ae89-9744-4c8e-b905-a6856c8be51e service nova] Enqueued Resource ID: acdf88b0-772b-4bfa-9bac-e0773934c81c with Priority: HIGHEST for action port [ 753.291952] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_rules [ 753.291952] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 753.291952] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdf88b0-772b-4bfa-9bac-e0773934c81c with Priority: HIGHEST for action port [ 753.297681] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.297681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.297681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.298011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.298095] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.300234] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.300377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.300856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-acdf88b0-772b-4bfa-9bac-e0773934c81c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.301035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acdf88b0-772b-4bfa-9bac-e0773934c81c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.301920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acdf88b0-772b-4bfa-9bac-e0773934c81c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.301920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acdf88b0-772b-4bfa-9bac-e0773934c81c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.301920] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acdf88b0-772b-4bfa-9bac-e0773934c81c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.536193] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 in Status: SUCCESS [ 753.536617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.536617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.537015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.537015] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.537015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.537015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.537185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.537272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.537359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.537449] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.806537] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.806698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.806898] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port acdf88b0-772b-4bfa-9bac-e0773934c81c with status ACTIVE [ 753.807109] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.807483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.807483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.807989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.807989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.807989] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.807989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.808180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.808281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.808336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.808479] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.809131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.809240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.809665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.809665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.809665] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: acdf88b0-772b-4bfa-9bac-e0773934c81c is going to be updated. [ 753.838713] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.838713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.838713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.838713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.838713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.838713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acdf88b0-772b-4bfa-9bac-e0773934c81c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.040888] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.546440] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dcaf011c-cc1f-4e0b-b169-b433df9cce25: rpc.has_security_group_logging(os_id): False [ 754.571926] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.572182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.572182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.572408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.572499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.572755] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.572843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.572900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.573063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.573287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.573287] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 is going to be created. [ 754.631928] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.631928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.632158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.632222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.632409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.649161] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 in Status: IN_PROGRESS for 2s [ 754.658223] env[63014]: INFO networking_nsxv3.common.synchronization [req-325f304c-6721-46f0-a8e8-4d74f68250b5 req-8c0f660d-d43f-4a5b-ad12-96bff3e1f068 tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 754.658820] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 754.659327] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.659516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.659617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.659856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.660381] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.660381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.660381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.660381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.660630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.660630] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.701126] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b in Status: SUCCESS [ 754.702507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.889569] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: SUCCESS [ 754.890499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.893009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.893009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.893009] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.893009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.893009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.893009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.893009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.893009] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.988183] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-812 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.988446] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.988600] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.988973] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.990058] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.990851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.990851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.990851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.990995] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.991121] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.991235] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 754.991354] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 754.991474] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 754.991585] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 754.991686] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 754.991821] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.014838] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.014838] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 755.015256] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.015256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.015635] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-33e7d5b3-e767-4ffc-82f6-20116cdea442 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.015832] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-33e7d5b3-e767-4ffc-82f6-20116cdea442" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.015942] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-33e7d5b3-e767-4ffc-82f6-20116cdea442" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.016305] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-33e7d5b3-e767-4ffc-82f6-20116cdea442" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.016545] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33e7d5b3-e767-4ffc-82f6-20116cdea442',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.164365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.164604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.164684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.164952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.165087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.165351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.165455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.165518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.165695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.165790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.165897] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c already deleted. [ 755.165997] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.394691] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.521493] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.521802] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.521900] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.522133] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.522285] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.522443] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 33e7d5b3-e767-4ffc-82f6-20116cdea442 not found, creating... [ 755.523038] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.523038] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.523038] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.523384] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.524572] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.525736] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.525900] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.526856] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.527241] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.527335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.527482] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 33e7d5b3-e767-4ffc-82f6-20116cdea442 is going to be created. [ 755.554194] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.554194] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.554194] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.554194] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.555285] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.555638] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-33e7d5b3-e767-4ffc-82f6-20116cdea442" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.898110] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.303948] env[63014]: INFO networking_nsxv3.common.synchronization [req-325f304c-6721-46f0-a8e8-4d74f68250b5 req-d734c69d-8c11-4547-a1f2-e43090cf1a4a service nova] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 756.304250] env[63014]: INFO networking_nsxv3.common.synchronization [req-325f304c-6721-46f0-a8e8-4d74f68250b5 req-d734c69d-8c11-4547-a1f2-e43090cf1a4a service nova] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 756.304407] env[63014]: INFO networking_nsxv3.common.synchronization [req-325f304c-6721-46f0-a8e8-4d74f68250b5 req-d734c69d-8c11-4547-a1f2-e43090cf1a4a service nova] Enqueued Resource ID: 33e7d5b3-e767-4ffc-82f6-20116cdea442 with Priority: HIGHEST for action port [ 756.304739] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 756.304905] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 756.305014] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e7d5b3-e767-4ffc-82f6-20116cdea442 with Priority: HIGHEST for action port [ 756.305689] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.305864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.305938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.306177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.306298] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.307249] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.307387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.307458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.307648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.307828] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.307950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.308021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.308197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.308293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.308382] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.309246] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-33e7d5b3-e767-4ffc-82f6-20116cdea442 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.309387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33e7d5b3-e767-4ffc-82f6-20116cdea442" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.309467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33e7d5b3-e767-4ffc-82f6-20116cdea442" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.310167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33e7d5b3-e767-4ffc-82f6-20116cdea442" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.310282] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33e7d5b3-e767-4ffc-82f6-20116cdea442',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.401780] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.401950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.401999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.402239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.402326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.402426] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb is going to be updated. [ 756.436119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.436276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.436346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.436648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.436796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.445243] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: IN_PROGRESS for 2s [ 756.661454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 in Status: SUCCESS [ 756.661786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.819022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33e7d5b3-e767-4ffc-82f6-20116cdea442 with status ACTIVE [ 756.819022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.819022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.819022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.819022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.819022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33e7d5b3-e767-4ffc-82f6-20116cdea442 is going to be updated. [ 756.820969] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.822307] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.822630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.856471] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.856471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.856471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.856471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.856471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.856834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33e7d5b3-e767-4ffc-82f6-20116cdea442" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.324395] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.830908] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.831223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.831223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.831390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.831485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.831586] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be created. [ 757.853769] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.853941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.854038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.854424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.854622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.864452] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: UNINITIALIZED for 2s [ 758.458034] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: SUCCESS [ 758.458279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.458448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.458673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.458867] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.459060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.459167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.459347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.459452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.459549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.459655] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.962965] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.963287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.963287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.963500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.963689] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.963790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.963879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.964075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.964195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.964295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.964460] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.964572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.964643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.964809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.964959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.965065] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.965132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.965265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.965340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.965425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.965514] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.106866] env[63014]: INFO networking_nsxv3.common.synchronization [req-47f3d823-cbc2-46fd-8f96-47c471e840e0 req-e22fd1d4-547b-4b82-b882-caa1b62f4c96 tempest-ServerGroupTestJSON-1752232908 tempest-ServerGroupTestJSON-1752232908-project-member] Enqueued Resource ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b with Priority: HIGHEST for action security_group_members [ 759.106866] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b with Priority: HIGHEST for action security_group_members [ 759.106960] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-24d80c6b-3ebf-4ee6-8524-63b081da521b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.107083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.107761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.107761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.107761] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.107761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.107761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.108146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.108146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.108146] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24d80c6b-3ebf-4ee6-8524-63b081da521b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.471028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69b3470e-796f-409b-8367-cd3cf14ca4fb: rpc.has_security_group_logging(os_id): False [ 759.488083] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.488306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.488380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.488602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.508131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.508373] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.508489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.508556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.508756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.508841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.509067] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.509173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.509239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.509390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.509466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.509677] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.509772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.509834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.509974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.510064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.510151] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb is going to be updated. [ 759.564265] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.564470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.564518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.564750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.564895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.577229] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: IN_PROGRESS for 2s [ 759.609843] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.610017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.610096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.610316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.610412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.610634] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.610835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.610835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.610948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.611011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.611099] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b is going to be updated. [ 759.699739] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.700073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.700163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.700383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.700548] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.711976] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b in Status: IN_PROGRESS for 2s [ 759.874021] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 759.874359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.874545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.874760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.874948] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.875079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.875158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.875315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.875397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.875481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.875570] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.381787] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.887428] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9141a736-220e-4a6b-b407-916c87c8099c: rpc.has_security_group_logging(os_id): False [ 760.906856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.906856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.906856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.906856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.906856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.906856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.906856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.906856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.906856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.906856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.906856] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be created. [ 760.965708] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.965708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.965708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.965708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.965708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.976482] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 761.073074] env[63014]: INFO networking_nsxv3.common.synchronization [req-50f07b32-75b6-47ce-b56e-37fa3376a7ed req-c3c23910-1489-4a48-a4a2-d42d5458869a tempest-ServerRescueTestJSON-1023946604 tempest-ServerRescueTestJSON-1023946604-project-member] Enqueued Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 761.073146] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 761.073420] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.074712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.074783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.075071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.076681] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.076681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.076681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.076681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.076681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.077109] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.581627] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.581627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.581627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.582077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.582077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.582318] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.582524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.582591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.582762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.582843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.582933] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 already deleted. [ 761.583020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.590342] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: SUCCESS [ 761.590627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.600335] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.600530] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-633" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.600658] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-633" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.600980] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-633" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.601263] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.601429] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.601550] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.601772] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.601918] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.602173] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.602296] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.602406] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.602517] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.602629] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 761.602747] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.602885] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.620048] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.620274] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 761.620425] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.620600] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-633" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.620924] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-e31fefbd-2287-475c-b0db-bc70c2470652 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.621109] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-e31fefbd-2287-475c-b0db-bc70c2470652" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.621229] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-e31fefbd-2287-475c-b0db-bc70c2470652" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.621541] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-e31fefbd-2287-475c-b0db-bc70c2470652" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.621674] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31fefbd-2287-475c-b0db-bc70c2470652',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.723615] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b in Status: SUCCESS [ 761.723830] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24d80c6b-3ebf-4ee6-8524-63b081da521b deletion is rescheduled due to dependency. [ 761.723981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24d80c6b-3ebf-4ee6-8524-63b081da521b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.124895] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.125054] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.125249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.125650] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.125822] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.125995] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port e31fefbd-2287-475c-b0db-bc70c2470652 not found, creating... [ 762.126311] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.126614] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.126885] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.127090] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.127244] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.127875] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.128117] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.128250] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.128554] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.128755] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.129023] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: e31fefbd-2287-475c-b0db-bc70c2470652 is going to be created. [ 762.151088] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.151328] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.151459] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.151743] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.151972] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.152320] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-e31fefbd-2287-475c-b0db-bc70c2470652" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.996675] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 762.996675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.293715] env[63014]: INFO networking_nsxv3.common.synchronization [req-50f07b32-75b6-47ce-b56e-37fa3376a7ed req-a6549f9a-9d94-47fa-86d5-8abe17993728 service nova] Enqueued Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_rules [ 763.293905] env[63014]: INFO networking_nsxv3.common.synchronization [req-50f07b32-75b6-47ce-b56e-37fa3376a7ed req-a6549f9a-9d94-47fa-86d5-8abe17993728 service nova] Enqueued Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 763.294053] env[63014]: INFO networking_nsxv3.common.synchronization [req-50f07b32-75b6-47ce-b56e-37fa3376a7ed req-a6549f9a-9d94-47fa-86d5-8abe17993728 service nova] Enqueued Resource ID: e31fefbd-2287-475c-b0db-bc70c2470652 with Priority: HIGHEST for action port [ 763.294319] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_rules [ 763.294451] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 763.294542] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e31fefbd-2287-475c-b0db-bc70c2470652 with Priority: HIGHEST for action port [ 763.295096] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.295217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.295280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.295534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.295611] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.296467] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.296600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.296659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.296824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.297020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.297130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.297130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.297362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.297362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.297865] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.298396] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e31fefbd-2287-475c-b0db-bc70c2470652 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.298396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e31fefbd-2287-475c-b0db-bc70c2470652" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.298396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e31fefbd-2287-475c-b0db-bc70c2470652" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.298611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e31fefbd-2287-475c-b0db-bc70c2470652" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.298611] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e31fefbd-2287-475c-b0db-bc70c2470652',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.803175] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.803175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.803175] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.804031] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e31fefbd-2287-475c-b0db-bc70c2470652 with status ACTIVE [ 763.804031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.804221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.804221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.805521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.805521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.805521] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.805521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.805521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.805521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.805521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.806060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.806060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.806060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.806178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.806847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.806847] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e31fefbd-2287-475c-b0db-bc70c2470652 is going to be updated. [ 763.827918] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.828123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.828909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.829802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.829983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.830192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e31fefbd-2287-475c-b0db-bc70c2470652" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.309397] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.815887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.816146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.816226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.816522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.816669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.816752] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 is going to be created. [ 764.839858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.840089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.840173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.840438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.841164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.853099] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: UNINITIALIZED for 2s [ 766.863810] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: SUCCESS [ 766.864353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.864353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.864516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.864586] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.864717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.864786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.864967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.865070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.865143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.865246] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.367785] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.367999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.367999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.368316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.368554] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.368720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.368805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.369018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.369121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.369234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.369431] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.369537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.369598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.369739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.369876] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.369967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.370036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.370180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.370259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.370353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.370444] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.873914] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4: rpc.has_security_group_logging(os_id): False [ 767.897444] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.897444] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.897444] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.897444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.898060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.898480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.898734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.899045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.899402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.899837] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 is going to be created. [ 767.957022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.957022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.957022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.957022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.957022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.969716] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: IN_PROGRESS for 2s [ 768.295678] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 768.295794] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 769.984010] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: SUCCESS [ 769.984346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.576727] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1a5f89a-e6fe-4145-9110-703689ebf4f4 req-d7b6336c-87fc-4440-beb4-f4b9c103ac22 tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 770.577677] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 770.577787] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.577861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.577969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.579077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.579077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.579361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.579361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.579522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.579561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.579637] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.904349] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1a5f89a-e6fe-4145-9110-703689ebf4f4 req-8c609253-c3b8-452a-8335-512e80d9e719 tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 770.905017] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 770.905405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.905405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.086050] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.086376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.086376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.093063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.107818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.109062] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.109062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.109062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.111030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.111030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.111030] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 771.132874] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.133121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.133199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.133415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.133557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.143840] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 771.284582] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-374 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.284812] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-374" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.284957] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-374" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.285381] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-374" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.285722] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.285908] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.286163] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.286469] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.286695] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.286964] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.287172] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.287354] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.287515] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.287691] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 771.287847] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.288039] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.312387] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.312581] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 771.312743] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.312935] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-374" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.313328] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.313506] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.313633] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.313982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.314140] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.816776] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.817052] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.817476] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.817555] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.817655] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.817809] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a not found, creating... [ 771.818094] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.818252] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.818373] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.818605] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.818735] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.819097] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.819504] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.819504] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.819624] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.819758] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.819917] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a is going to be created. [ 771.839741] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.839954] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.840103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.840376] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.840689] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.840818] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.078424] env[63014]: INFO networking_nsxv3.common.synchronization [req-5f73eb95-2dad-459c-a54b-796de0d35b67 req-a3062423-3b12-4f06-92ee-64235cd30fe1 tempest-ServersAdminNegativeTestJSON-817582727 tempest-ServersAdminNegativeTestJSON-817582727-project-member] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 772.079452] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 772.079787] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.079931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.080151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.080668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.080942] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.081111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.081213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.082635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.082738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.082849] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.579018] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1a5f89a-e6fe-4145-9110-703689ebf4f4 req-cb2fe336-40da-4536-94a7-50bc8892efd1 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 772.582124] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1a5f89a-e6fe-4145-9110-703689ebf4f4 req-cb2fe336-40da-4536-94a7-50bc8892efd1 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 772.582124] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1a5f89a-e6fe-4145-9110-703689ebf4f4 req-cb2fe336-40da-4536-94a7-50bc8892efd1 service nova] Enqueued Resource ID: bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a with Priority: HIGHEST for action port [ 772.582716] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 772.586365] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 772.586365] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a with Priority: HIGHEST for action port [ 772.586365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.586365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.586365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.586365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.586365] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.586365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.586365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.586827] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.586827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.586827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.587042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.587042] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.588031] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.089323] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.089530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.089619] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a with status ACTIVE [ 773.089784] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.089890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.089956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.090241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.090369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.090520] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.090635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.090700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.090856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.090935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.091267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.091267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.091432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.091470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.091513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.091592] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a is going to be updated. [ 773.092713] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.113120] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.113322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.113322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.114060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.114060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.115556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd0a8c29-9f3b-4ae3-8a6b-0768f2d74b9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.157484] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 773.157672] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb deletion is rescheduled due to dependency. [ 773.157789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.158564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.158564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.158564] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.158564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.158564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.158799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.158799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.158861] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.570334] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.572018] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.572018] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.572018] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.572018] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.575777] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.575777] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.575777] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.575777] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.575777] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.575777] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.575777] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.575777] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.575777] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 773.575777] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.575777] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.594417] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.594417] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 773.594705] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.595300] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.595905] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-97a551f1-b0ee-4915-a1cb-06ddea4c148b taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.596810] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-97a551f1-b0ee-4915-a1cb-06ddea4c148b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.598387] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-97a551f1-b0ee-4915-a1cb-06ddea4c148b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.598387] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-97a551f1-b0ee-4915-a1cb-06ddea4c148b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.598387] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97a551f1-b0ee-4915-a1cb-06ddea4c148b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.601048] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.601048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.601048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.601309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.601357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.601517] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb is going to be updated. [ 773.626477] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.626907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.627073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.627512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.627512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.634958] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: IN_PROGRESS for 2s [ 773.661775] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.104441] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.107030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.107030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.107030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.107030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.107030] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 97a551f1-b0ee-4915-a1cb-06ddea4c148b not found, creating... [ 774.107030] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.107030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.107030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.107030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.107030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.107778] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.108166] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.108730] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.109261] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.109541] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.109798] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 97a551f1-b0ee-4915-a1cb-06ddea4c148b is going to be created. [ 774.130800] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.130800] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.130800] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.130800] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.130800] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.131054] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-97a551f1-b0ee-4915-a1cb-06ddea4c148b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.166255] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.670425] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.670679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.670679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.670920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.670956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.671045] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 774.699424] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.699764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.699873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.700125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.700283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.711627] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 775.044289] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1a5f89a-e6fe-4145-9110-703689ebf4f4 req-f3b2e02c-2f9f-42ee-b28b-2e92ff53aed4 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 775.044289] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1a5f89a-e6fe-4145-9110-703689ebf4f4 req-f3b2e02c-2f9f-42ee-b28b-2e92ff53aed4 service nova] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 775.044289] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1a5f89a-e6fe-4145-9110-703689ebf4f4 req-f3b2e02c-2f9f-42ee-b28b-2e92ff53aed4 service nova] Enqueued Resource ID: 97a551f1-b0ee-4915-a1cb-06ddea4c148b with Priority: HIGHEST for action port [ 775.044289] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_rules [ 775.044289] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 775.044289] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97a551f1-b0ee-4915-a1cb-06ddea4c148b with Priority: HIGHEST for action port [ 775.045254] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.045486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.045738] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.045879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.046013] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-97a551f1-b0ee-4915-a1cb-06ddea4c148b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.046115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97a551f1-b0ee-4915-a1cb-06ddea4c148b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.046239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97a551f1-b0ee-4915-a1cb-06ddea4c148b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.046451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97a551f1-b0ee-4915-a1cb-06ddea4c148b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.046530] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97a551f1-b0ee-4915-a1cb-06ddea4c148b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.401044] env[63014]: INFO networking_nsxv3.common.synchronization [None req-1b6cdc22-a317-4b2d-a420-48ac122a76ad tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_rules [ 775.401700] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_rules [ 775.401984] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.402139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.402220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.402454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.402595] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.539890] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ee25b359-1835-4bac-9baa-36a7fc92ee1a tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_rules [ 775.539890] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_rules [ 775.539890] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.539890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.553972] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97a551f1-b0ee-4915-a1cb-06ddea4c148b with status ACTIVE [ 775.553972] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.553972] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.553972] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.553972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.553972] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97a551f1-b0ee-4915-a1cb-06ddea4c148b is going to be updated. [ 775.573919] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.575091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.575230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.575672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.578112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.578370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97a551f1-b0ee-4915-a1cb-06ddea4c148b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.645255] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: SUCCESS [ 775.645255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.922873] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.922873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.922873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.923293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.923293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.923293] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e already deleted. [ 775.923293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.923470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.925636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.925749] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.446197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.446387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.446464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.446724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.446823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.446935] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e already deleted. [ 776.447029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.722106] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 776.722444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.722685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.722907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.723112] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.723224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.723283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.723440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.723515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.723612] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.226017] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.727991] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.231979] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.232482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.232482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.233703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.233703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.233703] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 778.264258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.264258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.264258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.264565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.264686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.273409] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 779.127278] env[63014]: INFO networking_nsxv3.common.synchronization [req-eb7195fe-7926-4842-8688-eb6bb046d414 req-2c78e79a-6031-4f0f-bcc1-7f6c7ca6d9da tempest-ServersWithSpecificFlavorTestJSON-1510674973 tempest-ServersWithSpecificFlavorTestJSON-1510674973-project-member] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 779.127814] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 779.128114] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.128338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.128426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.128592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.128746] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.128849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.128910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.129859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.129859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.129859] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.631845] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.631845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.632369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.632369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.654990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.655256] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.655385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.655447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.655631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.655713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.655837] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be updated. [ 779.688320] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.688474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.688520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.689387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.689387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.707623] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: IN_PROGRESS for 2s [ 780.228789] env[63014]: INFO networking_nsxv3.common.synchronization [req-aa2329e0-4ff2-4eb7-a91b-808f91873c35 req-62831781-87cf-4735-8da3-8b37e56a3d21 tempest-ServersNegativeTestJSON-729475527 tempest-ServersNegativeTestJSON-729475527-project-member] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 780.229540] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 780.231220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.231220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.231220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.231220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.231220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.231220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.231220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.231612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.231612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.231612] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.283513] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 780.283513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.283643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.284164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.284164] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.284324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.284324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.284542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.284610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.284661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.284760] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.286639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.287120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.287331] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.287505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.287709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.288031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.288159] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.288412] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.724099] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.724442] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.724557] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.724999] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.725527] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.725707] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.725840] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.726109] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.727610] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.728814] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.728814] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.728814] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.728814] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.728814] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 780.728814] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.729053] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.736389] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.736603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.736719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.737026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.737152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.737427] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.737561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.737658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.737887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.738015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.738141] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 already deleted. [ 780.738299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.747902] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.748201] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 780.748374] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.748642] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.749193] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-33bfc3ed-0b60-482a-9c61-857bb5452ee0 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.749562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.749776] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.750272] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.750494] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33bfc3ed-0b60-482a-9c61-857bb5452ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.790386] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.790535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.791441] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.853985] env[63014]: INFO networking_nsxv3.common.synchronization [req-13c4c374-fb74-4246-8a99-ec350a9720aa req-60b6525c-b31b-4273-a953-eb3abfacdb34 tempest-ServersAdminTestJSON-1268263957 tempest-ServersAdminTestJSON-1268263957-project-member] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 780.854640] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 780.854923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.855079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.855151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.855364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.855536] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.855640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.855704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.855856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.855943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.856049] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.254634] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.254810] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.255220] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.255681] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.255776] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.255989] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 33bfc3ed-0b60-482a-9c61-857bb5452ee0 not found, creating... [ 781.258441] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.258441] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.258441] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.258441] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.258730] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.259065] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.259223] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.259555] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.259695] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.260032] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.260077] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 33bfc3ed-0b60-482a-9c61-857bb5452ee0 is going to be created. [ 781.281875] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.284603] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.284811] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.285128] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.285491] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.285686] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.294017] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.360372] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.716471] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: SUCCESS [ 781.716772] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 deletion is rescheduled due to dependency. [ 781.716995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.796206] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.802367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.802367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.802367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.802367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.802367] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 781.830031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.830031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.830031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.830031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.830031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.844581] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 781.864941] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.266689] env[63014]: INFO networking_nsxv3.common.synchronization [req-aa2329e0-4ff2-4eb7-a91b-808f91873c35 req-0ff20561-416a-46f5-bb3d-6d4bc46f92ee service nova] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_rules [ 782.266689] env[63014]: INFO networking_nsxv3.common.synchronization [req-aa2329e0-4ff2-4eb7-a91b-808f91873c35 req-0ff20561-416a-46f5-bb3d-6d4bc46f92ee service nova] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 782.266689] env[63014]: INFO networking_nsxv3.common.synchronization [req-aa2329e0-4ff2-4eb7-a91b-808f91873c35 req-0ff20561-416a-46f5-bb3d-6d4bc46f92ee service nova] Enqueued Resource ID: 33bfc3ed-0b60-482a-9c61-857bb5452ee0 with Priority: HIGHEST for action port [ 782.266689] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_rules [ 782.266689] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 782.271033] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bfc3ed-0b60-482a-9c61-857bb5452ee0 with Priority: HIGHEST for action port [ 782.271033] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.271033] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.271033] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.271033] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.271033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.271033] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.276158] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-33bfc3ed-0b60-482a-9c61-857bb5452ee0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.276158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.276158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.276158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.276158] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33bfc3ed-0b60-482a-9c61-857bb5452ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.370024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.370024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.370024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.370024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.370024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.370024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 782.395772] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.395941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.395985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.396210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.396354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.405063] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 782.778134] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.779226] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.779382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.779540] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33bfc3ed-0b60-482a-9c61-857bb5452ee0 with status ACTIVE [ 782.779745] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.779925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.779964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.780194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.780315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.780531] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.784020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.784020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.784020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.784020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.784020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.784020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.784020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.784020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.784020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.784020] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33bfc3ed-0b60-482a-9c61-857bb5452ee0 is going to be updated. [ 782.802912] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.802912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.802912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.802912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.803438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.803438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.285927] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.788923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.789136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.789228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.789504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.789616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.789741] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be created. [ 783.811625] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.812018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.812018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.812382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.812648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.821632] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: UNINITIALIZED for 2s [ 783.852925] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 783.853355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.853575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.853847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.854090] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.854305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.854425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.854641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.858185] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.858185] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.858185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.858185] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.359399] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef90f51b-2d80-447d-910c-f5ca10a227fb: rpc.has_security_group_logging(os_id): False [ 784.376635] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.377437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.377437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.377437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.377437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.377649] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.378020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.378136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.378324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.378449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.378696] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.378971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.378971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.379079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.379170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.379495] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.379637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.379732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.379907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.380036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.380169] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 784.415283] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 784.415568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.449619] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.449919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.450016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.450309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.450689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.464195] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 785.412943] env[63014]: INFO networking_nsxv3.common.synchronization [req-52d997c4-2411-4a66-9dfd-47397850f27d req-2c165ee5-11ae-4666-acf2-10f5d9ddfbbb tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 785.414185] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 785.414901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.415264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.415495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.417926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.417926] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.417926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.417926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.417926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.417926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.417926] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.831633] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 785.832167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.832370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.832815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.832815] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.833218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.833218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.833218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.833218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.833355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.833387] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.921130] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.113157] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.113270] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-84" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.113314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-84" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.115550] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-84" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.115550] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.115550] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.115550] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.115550] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.115550] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.115550] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.115550] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.115550] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.115550] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.115550] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 786.115550] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.115550] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.137558] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.138779] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 786.138975] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.140045] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-84" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.140045] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.140045] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.140045] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.140530] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.140530] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.335987] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.336590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.336718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.336962] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.337361] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.337469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.337549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.337723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.337822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.337926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.339267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.339393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.339458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.339920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.340017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.340278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.340343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.340507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.340606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.340692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.340785] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.425364] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.489113] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 786.489361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.489546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.489773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.489860] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.643137] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.643376] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.643612] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.643927] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.644075] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.644242] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 not found, creating... [ 786.644589] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.644758] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.644878] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.645361] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.645361] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.645719] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.645996] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.646287] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.646674] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.646914] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.647108] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 is going to be created. [ 786.666491] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.666654] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.666654] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.666934] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.667182] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.667502] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.844362] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 549b1fb9-6c49-4106-8a22-052debb3b7f9: rpc.has_security_group_logging(os_id): False [ 786.875619] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.875787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.875859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.876091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.876186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.876375] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.876477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.876539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.876695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.876764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.876965] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.877066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.877114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.877259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.877332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.877521] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.877733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.877791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.877935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.878017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.878131] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be created. [ 786.927258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.927468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.927555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.927798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.928049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.928049] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 786.956327] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.956614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.956614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.956778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.956962] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.971037] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 2s [ 786.993593] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.993788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.994395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.994395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.994395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.994630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.994630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.994750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.994839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.994931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.995036] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.997245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.997430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.997430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.997592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.998221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.011133] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 787.364814] env[63014]: INFO networking_nsxv3.common.synchronization [req-8d6ed541-f657-42c5-b7f2-de8132a1a773 req-08afddbc-5d3f-4191-bf03-94f09cb59b97 tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 787.365512] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 787.365925] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.367598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.367695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.367912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.368145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.368272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.368272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.368507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.368507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.368610] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.500467] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.500772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.564253] env[63014]: INFO networking_nsxv3.common.synchronization [req-8d6ed541-f657-42c5-b7f2-de8132a1a773 req-b6d82995-70a1-4b92-8b10-74b322c56950 tempest-ServersTestMultiNic-2061756355 tempest-ServersTestMultiNic-2061756355-project-member] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 787.569621] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGHEST for action security_group_members [ 787.570018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.570337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.604197] env[63014]: INFO networking_nsxv3.common.synchronization [req-52d997c4-2411-4a66-9dfd-47397850f27d req-bb5f8246-55bf-4434-ac3d-acbf243443b0 service nova] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 787.604197] env[63014]: INFO networking_nsxv3.common.synchronization [req-52d997c4-2411-4a66-9dfd-47397850f27d req-bb5f8246-55bf-4434-ac3d-acbf243443b0 service nova] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 787.604608] env[63014]: INFO networking_nsxv3.common.synchronization [req-52d997c4-2411-4a66-9dfd-47397850f27d req-bb5f8246-55bf-4434-ac3d-acbf243443b0 service nova] Enqueued Resource ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with Priority: HIGHEST for action port [ 787.604954] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 787.605100] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 787.605297] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with Priority: HIGHEST for action port [ 787.605554] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.605682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.605743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.606582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.606700] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.607643] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.607850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.607943] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.608104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.608169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.608358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.608437] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.872723] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.111107] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.111245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.111676] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with status ACTIVE [ 788.111676] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.111676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.111846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.112419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.112419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.112419] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.112419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.112419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.112652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.112652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.113083] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.113083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.113083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.113083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.113267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.113267] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 is going to be updated. [ 788.143208] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.143359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.143455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.143667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.143806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.143967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.375773] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.491583] env[63014]: INFO networking_nsxv3.common.synchronization [req-829aa909-cd1a-4b38-971b-44b045ceec18 req-6b8d29c2-0635-4c46-b062-ce9b3504bdfe tempest-VolumesAssistedSnapshotsTest-148737378 tempest-VolumesAssistedSnapshotsTest-148737378-project-member] Enqueued Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_members [ 788.492481] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGHEST for action security_group_members [ 788.493344] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.493736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.495950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.495950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.495950] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.495950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.495950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.495950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.495950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.495950] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.880696] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.881061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.881061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.881201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.881262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.881365] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 788.911216] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.911216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.911216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.911216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.911216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.919392] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 788.984013] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 788.984294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.996835] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.996980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.997061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.997278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.018561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.018870] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.019031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.019113] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.019354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.019466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.019577] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 is going to be updated. [ 789.021227] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 789.021459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.021966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.022205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.022398] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.022514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.022593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.022765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.022865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.022966] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.045694] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.045831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.045902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.046123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.046341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.053915] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 in Status: IN_PROGRESS for 2s [ 789.527064] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.028113] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.132844] env[63014]: INFO networking_nsxv3.common.synchronization [req-39627c37-12d5-4312-b7b1-a5853eb6f007 req-92ba19c0-b7d1-4ed3-af07-71c0330f2542 tempest-MultipleCreateTestJSON-401204873 tempest-MultipleCreateTestJSON-401204873-project-member] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 790.133929] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 790.135057] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.136045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.136283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.136782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.137796] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.137796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.137796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.138011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.138011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.138148] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.530770] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.530931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.531027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.531321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.531430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.531525] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 790.558133] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.558285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.558353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.558555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.558703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.568069] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 790.640822] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.640908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.640908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.641192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.641250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.641449] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.641567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.641606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.641867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.641867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.642174] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 already deleted. [ 790.642174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.682619] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.682619] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.682939] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.682994] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.683256] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.683440] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.683561] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.683801] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.684045] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.684261] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.684406] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.684524] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.684651] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.684767] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 790.684888] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.685101] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.705863] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.706019] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 790.706229] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.706324] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.706690] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.706794] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.706911] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.707244] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.707385] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4ffaea8-2e4f-420f-a63b-1548a6f07c42',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.929394] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 790.929645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.930330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.930330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.930330] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.930734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.930858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.931049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.931139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.931229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.931406] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.931494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.931557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.931700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.931841] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.931936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.931990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.932185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.932397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.932527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.932623] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.933461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.933639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.933791] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.933890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.933954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.934111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.934188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.934340] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.063199] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 in Status: SUCCESS [ 791.063464] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 deletion is rescheduled due to dependency. [ 791.063626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.209387] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.209681] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.209816] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.210122] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.210275] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.210432] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port a4ffaea8-2e4f-420f-a63b-1548a6f07c42 not found, creating... [ 791.210695] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.210846] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.210962] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.211218] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.211357] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.211638] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.211790] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.211904] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.212121] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.212326] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.212490] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: a4ffaea8-2e4f-420f-a63b-1548a6f07c42 is going to be created. [ 791.231033] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.231177] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.231217] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.231484] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.231707] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.231926] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.436854] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef90f51b-2d80-447d-910c-f5ca10a227fb: rpc.has_security_group_logging(os_id): False [ 791.438121] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.438121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.438121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.438121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.438326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.439388] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.439388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.439388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.439388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.439388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.439388] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 791.457717] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.457847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.458053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.458966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.458966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.458966] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.458966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.458966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.458966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.458966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.459257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.459257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.459257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.459375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.459375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.459540] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.459629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.459687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.459831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.459905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.459988] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be updated. [ 791.477603] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.477603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.477603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.477603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.477603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.489459] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 791.548454] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.548609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.548699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.548900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.549059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.565633] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: IN_PROGRESS for 2s [ 792.095216] env[63014]: INFO networking_nsxv3.common.synchronization [req-39627c37-12d5-4312-b7b1-a5853eb6f007 req-83d779ff-e406-4125-ad75-f5510997f1db service nova] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_rules [ 792.095216] env[63014]: INFO networking_nsxv3.common.synchronization [req-39627c37-12d5-4312-b7b1-a5853eb6f007 req-83d779ff-e406-4125-ad75-f5510997f1db service nova] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 792.095216] env[63014]: INFO networking_nsxv3.common.synchronization [req-39627c37-12d5-4312-b7b1-a5853eb6f007 req-83d779ff-e406-4125-ad75-f5510997f1db service nova] Enqueued Resource ID: a4ffaea8-2e4f-420f-a63b-1548a6f07c42 with Priority: HIGHEST for action port [ 792.095216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_rules [ 792.095216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 792.095216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4ffaea8-2e4f-420f-a63b-1548a6f07c42 with Priority: HIGHEST for action port [ 792.095216] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.095216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.095216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.095216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.095216] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.097373] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.097722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.097968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.098279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.098554] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.098782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.098923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.099162] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.099337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.099509] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.101033] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.101033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.101033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.101033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.101033] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4ffaea8-2e4f-420f-a63b-1548a6f07c42',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.577980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 792.578268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.578449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.578658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.578856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.578948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.579025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.579173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.579252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.579350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.579439] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.603166] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.603311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.603706] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.604311] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a4ffaea8-2e4f-420f-a63b-1548a6f07c42 with status ACTIVE [ 792.605197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.605197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.605197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.605197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.605197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.605197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.605197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.605597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.605597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.605597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.605690] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.605741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.605778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.606145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.606145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.607012] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a4ffaea8-2e4f-420f-a63b-1548a6f07c42 is going to be updated. [ 792.630298] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.630298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.630298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.630298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.630298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.630298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4ffaea8-2e4f-420f-a63b-1548a6f07c42" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.823362] env[63014]: INFO networking_nsxv3.common.synchronization [req-39627c37-12d5-4312-b7b1-a5853eb6f007 req-34d9df1d-542b-408b-b511-939aa29e04a4 tempest-MultipleCreateTestJSON-401204873 tempest-MultipleCreateTestJSON-401204873-project-member] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 792.824342] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 792.824803] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.825062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.083485] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.083639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.083709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.083936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.084122] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.084222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.084301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.084481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.084566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.084656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.085048] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.085048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.085048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.085172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.085270] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.085328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.085387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.085547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.085620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.086166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.086166] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.109653] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.181100] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.181330] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.181480] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.181783] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.182083] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.182262] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.182388] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.182621] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.182799] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.182971] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.183097] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.183210] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.183319] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.183426] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 793.183534] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.183664] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.201172] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.201342] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 793.204367] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.204367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.204367] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.204367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.204367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.204367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.204367] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e09a69e1-f4d3-4974-9ec4-e48987d67ce5',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.499414] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 793.499608] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb deletion is rescheduled due to dependency. [ 793.499733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.580524] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef90f51b-2d80-447d-910c-f5ca10a227fb in Status: SUCCESS [ 793.580524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.589122] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98c66d04-d431-433a-9b0a-4fec6e74caca: rpc.has_security_group_logging(os_id): False [ 793.603364] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.603556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.603659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.603785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.604530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.604530] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.604530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.604530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.604530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.604530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.605093] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.605093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.605093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.605777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.605864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.606083] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.606182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.606240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.606394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.606473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.606559] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 793.611270] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.611392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.611447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.611635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.611720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.611755] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be created. [ 793.632089] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.632247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.632305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.632523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.632685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.641471] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: UNINITIALIZED for 2s [ 793.670572] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.670572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.670572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.670798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.670798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.688448] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 793.705388] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.707421] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.707610] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.707952] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.708179] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.708399] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port e09a69e1-f4d3-4974-9ec4-e48987d67ce5 not found, creating... [ 793.708743] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.708969] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.709152] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.709463] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.709653] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.709986] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.711493] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.711493] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.711641] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.711784] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.711936] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: e09a69e1-f4d3-4974-9ec4-e48987d67ce5 is going to be created. [ 793.745703] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.745935] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.746118] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.746350] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.746583] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.746810] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.544275] env[63014]: INFO networking_nsxv3.common.synchronization [req-39627c37-12d5-4312-b7b1-a5853eb6f007 req-aebc4dcf-2741-4492-8f43-5fb8552ecf57 service nova] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_rules [ 794.544567] env[63014]: INFO networking_nsxv3.common.synchronization [req-39627c37-12d5-4312-b7b1-a5853eb6f007 req-aebc4dcf-2741-4492-8f43-5fb8552ecf57 service nova] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 794.544712] env[63014]: INFO networking_nsxv3.common.synchronization [req-39627c37-12d5-4312-b7b1-a5853eb6f007 req-aebc4dcf-2741-4492-8f43-5fb8552ecf57 service nova] Enqueued Resource ID: e09a69e1-f4d3-4974-9ec4-e48987d67ce5 with Priority: HIGHEST for action port [ 794.544947] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_rules [ 794.545087] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 794.545185] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e09a69e1-f4d3-4974-9ec4-e48987d67ce5 with Priority: HIGHEST for action port [ 794.545780] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.545891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.546091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.546175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.546350] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.547048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.547124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.547326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.547410] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e09a69e1-f4d3-4974-9ec4-e48987d67ce5',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.002425] env[63014]: INFO networking_nsxv3.common.synchronization [req-10b43fc2-7664-4a6a-8cc5-fa2195041dc5 req-56c7e2bc-9788-42b3-9d7c-f280050b9cef tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 795.002890] env[63014]: INFO networking_nsxv3.common.synchronization [req-10b43fc2-7664-4a6a-8cc5-fa2195041dc5 req-56c7e2bc-9788-42b3-9d7c-f280050b9cef tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 795.003185] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 795.003338] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 795.003654] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.003927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.004028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.004325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.004507] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.004618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.004682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.004885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.004972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.005076] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.006233] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.006347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.006417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.006609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.006773] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.006906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.006971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.007266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.007344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.007429] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.049120] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e09a69e1-f4d3-4974-9ec4-e48987d67ce5 with status ACTIVE [ 795.049383] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.049654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.049654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.049898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.049992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.050224] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.050329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.050415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.050576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.050658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.050879] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.051019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.051113] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.051275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.051357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.051519] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e09a69e1-f4d3-4974-9ec4-e48987d67ce5 is going to be updated. [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [req-10b43fc2-7664-4a6a-8cc5-fa2195041dc5 req-56c7e2bc-9788-42b3-9d7c-f280050b9cef tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [req-10b43fc2-7664-4a6a-8cc5-fa2195041dc5 req-56c7e2bc-9788-42b3-9d7c-f280050b9cef tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [req-10b43fc2-7664-4a6a-8cc5-fa2195041dc5 req-56c7e2bc-9788-42b3-9d7c-f280050b9cef tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_rules [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [req-10b43fc2-7664-4a6a-8cc5-fa2195041dc5 req-56c7e2bc-9788-42b3-9d7c-f280050b9cef tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [req-10b43fc2-7664-4a6a-8cc5-fa2195041dc5 req-56c7e2bc-9788-42b3-9d7c-f280050b9cef tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with Priority: HIGHEST for action port [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_rules [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with Priority: HIGHEST for action port [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 795.073458] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 795.075416] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.075416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.075416] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.075416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.075416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.075416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.075416] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.076722] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.076807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.076870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.077608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.077608] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.078135] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.078238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.078463] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.082506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.082862] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.082982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.083061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.083253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.083390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.083547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e09a69e1-f4d3-4974-9ec4-e48987d67ce5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.509010] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.514989] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.583111] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with status ACTIVE [ 795.583372] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.583485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.583485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.583703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.583776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.583959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.584061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.584120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.584270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.584406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.584593] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.584681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.584746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.584878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.584949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.585047] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 is going to be updated. [ 795.586349] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.586456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.610238] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.610238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.610238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.610238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.610238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.610238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.650705] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 795.651475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.651475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.651660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.652124] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.652301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.652410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.652690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.653131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.653311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.653487] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.655378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.656174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.656466] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.656650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.656776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.656952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.657102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.657252] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.708121] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 795.708121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.708121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.708121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.708121] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.013448] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.017354] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.156757] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.156757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.159922] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.215519] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.215683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.518577] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.518836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.518836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.519089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.519173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.519343] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 is going to be created. [ 796.520712] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.520834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.520890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.522366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.522366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.522535] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 796.551477] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.551700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.551826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.552153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.552405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.554952] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.555195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.555346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.555642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.555910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.565450] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 796.566561] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 in Status: UNINITIALIZED for 2s [ 796.662577] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.165272] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.165482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.165634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.165915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.166048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.166196] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 797.225848] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.226034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.226148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.226509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.226509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.238457] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 798.029103] env[63014]: INFO networking_nsxv3.common.synchronization [req-a8a56220-54b7-4752-b795-d90e9b82ed53 req-b8c8fcdf-8132-442f-96eb-194933846fc5 tempest-ImagesOneServerNegativeTestJSON-1556540069 tempest-ImagesOneServerNegativeTestJSON-1556540069-project-member] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 798.029678] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 798.029945] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.030077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.030144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.030351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.030505] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.030598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.030660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.030803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.030888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.030981] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.368993] env[63014]: INFO networking_nsxv3.common.synchronization [req-857fc326-8cea-49a4-a702-23cb0f601715 req-c4a96c79-c97e-41ac-9705-514f29ddc1aa tempest-ServersTestBootFromVolume-1738521807 tempest-ServersTestBootFromVolume-1738521807-project-member] Enqueued Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_members [ 798.369895] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba with Priority: HIGHEST for action security_group_members [ 798.369974] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c2e75af-7b53-4662-af96-bb7c5bccaeba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.374019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.374019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.374019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.374019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.374019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.374019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.374019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.374019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.374019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c2e75af-7b53-4662-af96-bb7c5bccaeba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.535381] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.535576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.535676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.536192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.556736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.557086] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.557220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.557282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.557495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.557585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.557678] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 798.583584] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.583584] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.583584] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.583584] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.583904] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.588022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.588022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.588022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.588022] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.588022] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.588022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 798.588022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 798.588022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 798.588022] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 798.588022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 798.588022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 798.591103] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 798.591372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.592459] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 in Status: SUCCESS [ 798.592684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.595425] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.595611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.595700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.595959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.596339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.599561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.599561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.599561] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.599561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.599561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.599561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.599561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.599561] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.600772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.600986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.601215] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.601355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.601438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.601632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.601739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.602077] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.612384] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 798.627503] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 798.627732] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 798.627881] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 798.628092] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.628450] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-9e29d284-4862-4ad8-9e68-0ce0d596f444 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.628679] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-9e29d284-4862-4ad8-9e68-0ce0d596f444" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.628743] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-9e29d284-4862-4ad8-9e68-0ce0d596f444" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.629283] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-9e29d284-4862-4ad8-9e68-0ce0d596f444" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.629283] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e29d284-4862-4ad8-9e68-0ce0d596f444',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.876034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.876202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.877025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.877025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.896299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.896454] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.896573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.896639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.896837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.896918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.897017] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba is going to be updated. [ 798.921344] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.921513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.921577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.921800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.921931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.930016] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba in Status: IN_PROGRESS for 2s [ 799.113257] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.113257] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.133197] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.133197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.133197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.133197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.133197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.134107] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 9e29d284-4862-4ad8-9e68-0ce0d596f444 not found, creating... [ 799.137087] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.137087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.137087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.137087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.137087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.137087] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.137087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.137087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.137087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.137087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.137517] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 9e29d284-4862-4ad8-9e68-0ce0d596f444 is going to be created. [ 799.158036] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.158036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.158036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.158036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.158036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.158253] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-9e29d284-4862-4ad8-9e68-0ce0d596f444" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.253870] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 799.254217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.254544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.254806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.255064] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.255187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.255240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.255405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.255496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.255611] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.613529] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.614554] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.758167] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.042616] env[63014]: INFO networking_nsxv3.common.synchronization [req-a8a56220-54b7-4752-b795-d90e9b82ed53 req-7a0592c4-79cf-4327-8ce5-63449655a582 service nova] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_rules [ 800.042616] env[63014]: INFO networking_nsxv3.common.synchronization [req-a8a56220-54b7-4752-b795-d90e9b82ed53 req-7a0592c4-79cf-4327-8ce5-63449655a582 service nova] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 800.042616] env[63014]: INFO networking_nsxv3.common.synchronization [req-a8a56220-54b7-4752-b795-d90e9b82ed53 req-7a0592c4-79cf-4327-8ce5-63449655a582 service nova] Enqueued Resource ID: 9e29d284-4862-4ad8-9e68-0ce0d596f444 with Priority: HIGHEST for action port [ 800.042961] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_rules [ 800.043019] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 800.043095] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e29d284-4862-4ad8-9e68-0ce0d596f444 with Priority: HIGHEST for action port [ 800.043403] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.043536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.043597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.043806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.043944] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.044942] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.045060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.045251] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e29d284-4862-4ad8-9e68-0ce0d596f444 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.045352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e29d284-4862-4ad8-9e68-0ce0d596f444" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.045423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e29d284-4862-4ad8-9e68-0ce0d596f444" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.045648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e29d284-4862-4ad8-9e68-0ce0d596f444" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.045757] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e29d284-4862-4ad8-9e68-0ce0d596f444',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.118252] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.118252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.118252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.118252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.118252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.118252] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 800.119798] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.120930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.120930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.121524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.121524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.121524] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 is going to be updated. [ 800.148155] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.148354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.148403] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.148591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.148737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.150969] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.150969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.150969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.150969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.150969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.161616] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 800.162454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 in Status: IN_PROGRESS for 2s [ 800.261408] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.548557] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.548557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.548557] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e29d284-4862-4ad8-9e68-0ce0d596f444 with status ACTIVE [ 800.548557] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.548557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.548557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.548858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.548858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.549044] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.549189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.549277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.549466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.549571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.549779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.549903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.549987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.550179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.550278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.550389] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e29d284-4862-4ad8-9e68-0ce0d596f444 is going to be updated. [ 800.571879] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.572095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.572145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.572435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.572534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.572715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e29d284-4862-4ad8-9e68-0ce0d596f444" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.620740] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 800.620965] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 deletion is rescheduled due to dependency. [ 800.621103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.621202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.621490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.621681] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.621798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.621858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.622052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.622141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.622268] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.765902] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.766118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.766187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.766361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.766455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.766646] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 800.795255] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.795405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.795475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.795756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.795914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.807198] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 800.940810] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba in Status: SUCCESS [ 800.940810] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c2e75af-7b53-4662-af96-bb7c5bccaeba deletion is rescheduled due to dependency. [ 800.940810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c2e75af-7b53-4662-af96-bb7c5bccaeba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.124095] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.496281] env[63014]: INFO networking_nsxv3.common.synchronization [None req-1b60a0e0-9899-4645-8285-3b18ca699cb0 None None] Enqueued Resource ID: af18802f-28e3-456f-88fc-6faa9b00c41c with Priority: HIGHEST for action port [ 801.496577] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af18802f-28e3-456f-88fc-6faa9b00c41c with Priority: HIGHEST for action port [ 801.497204] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-af18802f-28e3-456f-88fc-6faa9b00c41c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.497367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af18802f-28e3-456f-88fc-6faa9b00c41c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.497413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af18802f-28e3-456f-88fc-6faa9b00c41c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.497696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af18802f-28e3-456f-88fc-6faa9b00c41c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.497793] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af18802f-28e3-456f-88fc-6faa9b00c41c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.501821] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 801.501993] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 4ae68a51-f031-46b8-87be-89f116d19356 with Priority: HIGHEST for action security_group_members [ 801.502297] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 801.507566] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 801.507719] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ae68a51-f031-46b8-87be-89f116d19356 with Priority: HIGHEST for action security_group_members [ 801.507849] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 801.510484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.511102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.511102] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ae68a51-f031-46b8-87be-89f116d19356 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.511102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.511102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.511960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.511960] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.511960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.511960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.511960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.511960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.511960] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.513253] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.513562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.560888] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 4ae68a51-f031-46b8-87be-89f116d19356 with Priority: HIGHEST for action security_group_rules [ 801.561128] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 4ae68a51-f031-46b8-87be-89f116d19356 with Priority: HIGHEST for action security_group_members [ 801.561290] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 801.561447] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 801.562489] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_rules [ 801.562489] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 801.562489] env[63014]: INFO networking_nsxv3.common.synchronization [req-50cac840-0b05-4284-b3b0-6d213cf3e585 req-1db96d85-173c-45cb-a12f-66518c4cf04e tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with Priority: HIGHEST for action port [ 801.567210] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ae68a51-f031-46b8-87be-89f116d19356 with Priority: HIGHEST for action security_group_rules [ 801.567210] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_rules [ 801.567210] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 801.567210] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with Priority: HIGHEST for action port [ 801.567210] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_rules [ 801.567210] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ae68a51-f031-46b8-87be-89f116d19356 with Priority: HIGHEST for action security_group_members [ 801.567210] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 801.567210] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ae68a51-f031-46b8-87be-89f116d19356 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.567210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.567210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.567210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.567210] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.567210] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.567210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.567732] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.567732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.567732] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.567732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.568022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.568022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.568022] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.569606] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.569606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.569606] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ae68a51-f031-46b8-87be-89f116d19356 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.569606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.569606] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.569606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.627692] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.008411] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af18802f-28e3-456f-88fc-6faa9b00c41c [ 802.009178] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.009178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.009178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.009178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.009178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.009424] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af18802f-28e3-456f-88fc-6faa9b00c41c already deleted. [ 802.009424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af18802f-28e3-456f-88fc-6faa9b00c41c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.014910] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.070569] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 with status ACTIVE [ 802.070921] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.071110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.071232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.071570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.071724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.072092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.072193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.072278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.072505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.072609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.072839] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.072965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.073061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.073217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.073297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.073398] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8 is going to be updated. [ 802.074727] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ae68a51-f031-46b8-87be-89f116d19356 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.074899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.092821] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.092958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.093037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.093261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.093528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.093707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebf04dc1-17ab-41ed-b2d8-8cb39912ccf8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.131167] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.131532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.131532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.133480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.133480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.133480] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 802.167463] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.167900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.168180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.168574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.168861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.183425] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 802.183425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.186022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 in Status: SUCCESS [ 802.186022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.186022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.186022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.186022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.186022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.186022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.186022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.186022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.186022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.186022] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.187935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.188276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.188586] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.188843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.189050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.189315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.189575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.191021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.191021] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.192131] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 802.192619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.192935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.193259] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.193543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.193750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.194054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.196020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.196020] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.196020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.196020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.196020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.196020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.196020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.196936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.197164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.197396] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.519589] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.693882] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.694047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.699517] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.700504] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.701248] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.817027] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 802.817027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.817196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.817317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.817517] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.817639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.817719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.817863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.817947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.818064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.818227] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.818331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.818390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.818519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.818656] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.818746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.818803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.818956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.819043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.819114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.819257] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.022988] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.023208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.023269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.023502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.023606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.023730] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ae68a51-f031-46b8-87be-89f116d19356 is going to be created. [ 803.048461] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.048461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.048461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.048461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.048461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.058331] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ae68a51-f031-46b8-87be-89f116d19356 in Status: UNINITIALIZED for 2s [ 803.204024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8: rpc.has_security_group_logging(os_id): False [ 803.204890] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.205682] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.235784] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.235784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.235784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.235784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.235784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.235784] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.235784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.235784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.235784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.236629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.236629] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 is going to be created. [ 803.296348] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.296506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.296576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.296875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.297086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.307771] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 in Status: IN_PROGRESS for 2s [ 803.327022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e50835d8-af5a-48b2-b8ae-a4f696900f48: rpc.has_security_group_logging(os_id): False [ 803.344116] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.344344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.347516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.347516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.347516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.348602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.348602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.348669] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.348967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.348967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.349142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.349231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.349361] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be created. [ 803.408731] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.408950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.408950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.409126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.409304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.419951] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 803.580958] env[63014]: INFO networking_nsxv3.common.synchronization [req-0bacd1cb-c185-4d94-a37b-4ac273256bea req-1fa4a8d0-7376-463d-9026-762f791b3e1e tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 803.581541] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 803.581874] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.582015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.582083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.582347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.582506] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.582623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.582682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.582842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.582924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.583025] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.708447] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.708663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.708752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.709081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.709205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.709418] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 803.710991] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.711549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.711549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.711689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.711736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.711844] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 is going to be updated. [ 803.740165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.740425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.740425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.741349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.741349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.743603] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.743788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.743961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.744263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.744747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.755918] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 in Status: IN_PROGRESS for 2s [ 803.757524] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 803.842201] env[63014]: INFO networking_nsxv3.common.synchronization [None req-42530fd6-60f9-4295-a845-3cdd2a79a91f None None] Enqueued Resource ID: d3ff6b94-8d29-4f90-93b3-0e448b5a9165 with Priority: HIGHEST for action port [ 803.842201] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ff6b94-8d29-4f90-93b3-0e448b5a9165 with Priority: HIGHEST for action port [ 803.842201] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3ff6b94-8d29-4f90-93b3-0e448b5a9165 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.842201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3ff6b94-8d29-4f90-93b3-0e448b5a9165" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.845675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3ff6b94-8d29-4f90-93b3-0e448b5a9165" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.845675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3ff6b94-8d29-4f90-93b3-0e448b5a9165" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.845675] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3ff6b94-8d29-4f90-93b3-0e448b5a9165',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.927902] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.928140] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.928267] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.928615] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.928896] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.930566] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.930765] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.931050] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.931213] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.931436] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.931550] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 803.931661] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 803.931764] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 803.931868] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 803.931970] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 803.932112] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 803.960867] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 803.960997] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 803.961142] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 803.961314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.962034] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-fbc3df6d-7650-495b-832e-0eafc1f481aa taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.962034] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-fbc3df6d-7650-495b-832e-0eafc1f481aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.962034] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-fbc3df6d-7650-495b-832e-0eafc1f481aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.962395] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-fbc3df6d-7650-495b-832e-0eafc1f481aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.962567] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbc3df6d-7650-495b-832e-0eafc1f481aa',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.086788] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.086788] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.086788] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 already deleted. [ 804.086788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.202329] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 804.202556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.202721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.202960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.203136] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.203249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.203313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.203477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.203557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.203640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.203728] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.345820] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3ff6b94-8d29-4f90-93b3-0e448b5a9165 [ 804.346157] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.346255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.346255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.346484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.346588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.346706] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3ff6b94-8d29-4f90-93b3-0e448b5a9165 already deleted. [ 804.346801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3ff6b94-8d29-4f90-93b3-0e448b5a9165" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.469656] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.470147] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.470484] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.470631] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.470753] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.470909] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port fbc3df6d-7650-495b-832e-0eafc1f481aa not found, creating... [ 804.471497] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.471497] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.471497] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.471700] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.471823] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.472751] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.473287] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.473457] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.473911] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.474100] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.474278] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: fbc3df6d-7650-495b-832e-0eafc1f481aa is going to be created. [ 804.493148] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.493362] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.493564] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.494527] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.494861] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.495153] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-fbc3df6d-7650-495b-832e-0eafc1f481aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.705959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.705959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.706275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.706457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.706643] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.706744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.706805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.706968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.707091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.707150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.707313] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.707438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.707482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.708049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.708049] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.708049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.708049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.708049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.708255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.708255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.708255] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.830127] env[63014]: INFO networking_nsxv3.common.synchronization [req-248e4e2d-caee-494b-a8ee-81f1273b0443 req-3888edea-be7e-4ba5-a443-431ebc45fa52 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 4ae68a51-f031-46b8-87be-89f116d19356 with Priority: HIGHEST for action security_group_members [ 804.830127] env[63014]: INFO networking_nsxv3.common.synchronization [req-248e4e2d-caee-494b-a8ee-81f1273b0443 req-3888edea-be7e-4ba5-a443-431ebc45fa52 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 804.830127] env[63014]: INFO networking_nsxv3.common.synchronization [req-248e4e2d-caee-494b-a8ee-81f1273b0443 req-3888edea-be7e-4ba5-a443-431ebc45fa52 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 804.830127] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ae68a51-f031-46b8-87be-89f116d19356 with Priority: HIGHEST for action security_group_members [ 804.830127] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 804.831435] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 with Priority: HIGHEST for action security_group_members [ 804.831743] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ae68a51-f031-46b8-87be-89f116d19356 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.831907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.832081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.832201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.832872] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.833061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.915453] env[63014]: INFO networking_nsxv3.common.synchronization [None req-46a9649f-8a06-4fac-a50f-a7d0ce0b8fa7 None None] Enqueued Resource ID: 7833e60e-ca59-475e-8afc-533bce88be73 with Priority: HIGHEST for action port [ 804.916046] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7833e60e-ca59-475e-8afc-533bce88be73 with Priority: HIGHEST for action port [ 804.918134] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-7833e60e-ca59-475e-8afc-533bce88be73 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.918359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7833e60e-ca59-475e-8afc-533bce88be73" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.918359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7833e60e-ca59-475e-8afc-533bce88be73" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.918620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7833e60e-ca59-475e-8afc-533bce88be73" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.919145] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7833e60e-ca59-475e-8afc-533bce88be73',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.068331] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ae68a51-f031-46b8-87be-89f116d19356 in Status: SUCCESS [ 805.068331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.068331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.068331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.068572] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.068572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.068676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.072128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.072318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.072464] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.200657] env[63014]: INFO networking_nsxv3.common.synchronization [req-0bacd1cb-c185-4d94-a37b-4ac273256bea req-439e5618-bdd6-45c2-8251-b50b1240a74d service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 805.200880] env[63014]: INFO networking_nsxv3.common.synchronization [req-0bacd1cb-c185-4d94-a37b-4ac273256bea req-439e5618-bdd6-45c2-8251-b50b1240a74d service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 805.201075] env[63014]: INFO networking_nsxv3.common.synchronization [req-0bacd1cb-c185-4d94-a37b-4ac273256bea req-439e5618-bdd6-45c2-8251-b50b1240a74d service nova] Enqueued Resource ID: fbc3df6d-7650-495b-832e-0eafc1f481aa with Priority: HIGHEST for action port [ 805.201660] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 805.201894] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 805.201956] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbc3df6d-7650-495b-832e-0eafc1f481aa with Priority: HIGHEST for action port [ 805.206152] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.206330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.206412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.206705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.207147] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.208305] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.208463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.208543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.208783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.208984] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.209124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.209254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.209417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.211384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.211384] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.211384] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbc3df6d-7650-495b-832e-0eafc1f481aa taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.211384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbc3df6d-7650-495b-832e-0eafc1f481aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.211384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbc3df6d-7650-495b-832e-0eafc1f481aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.211384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbc3df6d-7650-495b-832e-0eafc1f481aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.211384] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbc3df6d-7650-495b-832e-0eafc1f481aa',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.215695] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08: rpc.has_security_group_logging(os_id): False [ 805.235268] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.235268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.235268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.235268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.235268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.235268] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.235268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.235268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.235268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.235268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.235268] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.235978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.235978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.235978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.235978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.235978] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.235978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.235978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.236254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.236254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.236254] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 805.293395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.294423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.294598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.294957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.295189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.309051] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 805.320859] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 in Status: SUCCESS [ 805.321023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.321111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.321312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.321435] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.423534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7833e60e-ca59-475e-8afc-533bce88be73 [ 805.423534] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.423534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.423534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.423534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.423534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.423534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7833e60e-ca59-475e-8afc-533bce88be73 already deleted. [ 805.423534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7833e60e-ca59-475e-8afc-533bce88be73" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.443852] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 805.445884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.445884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.445884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.445884] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.578111] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.578111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.578111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.578111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.578111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.578111] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.578111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.578111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.578111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.578111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.578111] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ae68a51-f031-46b8-87be-89f116d19356 is going to be deleted. [ 805.610077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.610077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.610077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.610077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.610306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.610306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.610509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.610675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.610782] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.610883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.610949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.611104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.611216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.611288] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.713021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.713021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.718772] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbc3df6d-7650-495b-832e-0eafc1f481aa with status ACTIVE [ 805.718772] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.718772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.718772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.718772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.718772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.718772] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.718772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.718772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.718772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.719325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.719325] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.719325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.719512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.720124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.720124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.720124] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbc3df6d-7650-495b-832e-0eafc1f481aa is going to be updated. [ 805.721232] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.744362] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.744362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.744362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.744362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.744362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.744362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbc3df6d-7650-495b-832e-0eafc1f481aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.768148] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 in Status: SUCCESS [ 805.768148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.768148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.768148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.768148] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.768148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.768148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.768148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.768148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.768148] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.772802] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 805.776044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.776044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.776044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.776044] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.776044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.776044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.776044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.776044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.776044] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.855832] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.855832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.855832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.855832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.855832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.855832] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 is going to be deleted. [ 805.908455] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.909260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.909349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.909600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.909708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.909825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.949529] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.949694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.949758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.949973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.950156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.950254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.950317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.951749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.951871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.951987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.952097] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.121887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.121887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.121887] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ae68a51-f031-46b8-87be-89f116d19356 already deleted. [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.121887] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.121887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.121887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.122708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.122708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.122708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.122708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.122708] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.224636] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.273358] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.273752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.273752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.273993] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.274106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.274410] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.274558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.274679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.274804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.274925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.275089] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 is going to be deleted. [ 806.278462] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.306034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.306034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.306034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.306034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.306034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.306034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.306034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.306373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.306373] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.306373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.306373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.306552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.306616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.306729] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.455476] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.455758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.455758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.455968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.456175] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.456278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.456344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.456500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.456592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.456720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.456901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.456998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.457080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.457229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.457367] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.457460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.457519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.457656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.457733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.457813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.457902] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.508657] env[63014]: INFO networking_nsxv3.common.synchronization [req-65ce9a27-8621-4131-97cf-d8a2e640f0bf req-620a5450-8974-41be-ad17-4e354c407a92 tempest-MigrationsAdminTest-518512597 tempest-MigrationsAdminTest-518512597-project-member] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 806.511268] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 806.511268] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.511268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.511268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.511268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.511268] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.511268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.511268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.511268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.511268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.511268] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.624952] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ae68a51-f031-46b8-87be-89f116d19356',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.626383] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.626383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.626383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.626597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.626879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.626879] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.627029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.627069] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.628486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.628486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.628486] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ae68a51-f031-46b8-87be-89f116d19356 already deleted. [ 806.628486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.728735] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.728889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.729556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.729556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.729556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.729556] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be created. [ 806.755217] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.755390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.755463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.755643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.755812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.765771] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: UNINITIALIZED for 2s [ 806.781663] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.812492] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.812640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.812709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.812930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.813025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.813230] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.813324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.813393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.813589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.813662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.813746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8 already deleted. [ 806.813822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb5c10ce-8bd7-4581-8ae0-ebf6f9f824f8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.815954] env[63014]: INFO networking_nsxv3.common.synchronization [None req-cb14f7f0-9962-4231-b51d-e33cb33c9fde None None] Enqueued Resource ID: df61732b-96f0-4e09-9cf5-1eb97f66f1bd with Priority: HIGHEST for action port [ 806.816507] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df61732b-96f0-4e09-9cf5-1eb97f66f1bd with Priority: HIGHEST for action port [ 806.816863] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-df61732b-96f0-4e09-9cf5-1eb97f66f1bd taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.817062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df61732b-96f0-4e09-9cf5-1eb97f66f1bd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.817062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df61732b-96f0-4e09-9cf5-1eb97f66f1bd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.817288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df61732b-96f0-4e09-9cf5-1eb97f66f1bd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.817373] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df61732b-96f0-4e09-9cf5-1eb97f66f1bd',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.878914] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-526 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.879377] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.879377] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.881032] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.881238] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.881396] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.881686] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.882423] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.882796] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.882839] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.882966] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.883138] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.883290] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.883416] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.884607] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.884607] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.902386] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.902662] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.902863] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.903087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-526" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.903533] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-16ede1ac-eef0-47ed-9daf-cbbf7de47352 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.903690] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-16ede1ac-eef0-47ed-9daf-cbbf7de47352" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.903839] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-16ede1ac-eef0-47ed-9daf-cbbf7de47352" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.905164] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-16ede1ac-eef0-47ed-9daf-cbbf7de47352" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.905363] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16ede1ac-eef0-47ed-9daf-cbbf7de47352',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.961279] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e50835d8-af5a-48b2-b8ae-a4f696900f48: rpc.has_security_group_logging(os_id): False [ 806.977852] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.978109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.978357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.978593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.978694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.978916] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.979041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.979110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.979318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.979362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.979521] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.979617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.979678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.979818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.979891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.980093] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.980219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.980321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.980430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.980542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.980600] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 807.014304] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.039858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.039858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.039858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.040057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.040209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.052039] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 807.128773] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ae68a51-f031-46b8-87be-89f116d19356: rpc.has_security_group_logging(os_id): False [ 807.153031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.153212] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.153288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.153519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.153612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.153846] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.153947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.154027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.154188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.154269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.154382] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ae68a51-f031-46b8-87be-89f116d19356 is going to be created. [ 807.188228] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/4ae68a51-f031-46b8-87be-89f116d19356], does not exist path=[/infra/domains/default/groups/4ae68a51-f031-46b8-87be-89f116d19356]."\n}' [ 807.188393] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ae68a51-f031-46b8-87be-89f116d19356 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4ae68a51-f031-46b8-87be-89f116d19356 [ 807.188491] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 807.270643] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.271466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.271742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.272263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.274276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.274838] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.275041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.275191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.275511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.275635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.275855] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.276105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.276359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.276605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.276803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.276954] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ae68a51-f031-46b8-87be-89f116d19356 is going to be created. [ 807.284820] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.285507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.289190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.289694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.289694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.289694] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 807.306765] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/4ae68a51-f031-46b8-87be-89f116d19356], does not exist path=[/infra/domains/default/groups/4ae68a51-f031-46b8-87be-89f116d19356]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4ae68a51-f031-46b8-87be-89f116d19356 [ 807.306988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ae68a51-f031-46b8-87be-89f116d19356" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.307758] env[63014]: Traceback (most recent call last): [ 807.307758] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 807.307758] env[63014]: return func(*args, **kwargs) [ 807.307758] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 807.307758] env[63014]: res.raise_for_status() [ 807.307758] env[63014]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 807.307758] env[63014]: raise HTTPError(http_error_msg, response=self) [ 807.307758] env[63014]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4ae68a51-f031-46b8-87be-89f116d19356 [ 807.307758] env[63014]: During handling of the above exception, another exception occurred: [ 807.307758] env[63014]: Traceback (most recent call last): [ 807.307758] env[63014]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 807.307758] env[63014]: listener.cb(fileno) [ 807.307758] env[63014]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 807.307758] env[63014]: result = function(*args, **kwargs) [ 807.307758] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 807.307758] env[63014]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 807.307758] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 807.307758] env[63014]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 807.307758] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 807.307758] env[63014]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 807.307758] env[63014]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 807.307758] env[63014]: res.raise_for_status() [ 807.307758] env[63014]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 807.307758] env[63014]: raise HTTPError(http_error_msg, response=self) [ 807.307758] env[63014]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4ae68a51-f031-46b8-87be-89f116d19356 [ 807.307758] env[63014]: Removing descriptor: 23 [ 807.321790] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df61732b-96f0-4e09-9cf5-1eb97f66f1bd [ 807.322022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.322767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.322767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.322767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.322767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.322767] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df61732b-96f0-4e09-9cf5-1eb97f66f1bd already deleted. [ 807.323302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df61732b-96f0-4e09-9cf5-1eb97f66f1bd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.332230] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 807.332788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.339093] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.339335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.339409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.339677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.339855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.347957] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 807.412020] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.412020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.412020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.412020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.412020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.412020] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 16ede1ac-eef0-47ed-9daf-cbbf7de47352 not found, creating... [ 807.412020] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.412020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.412020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.412020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.412808] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.413318] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.413673] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.416018] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.416018] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.416018] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.416018] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 16ede1ac-eef0-47ed-9daf-cbbf7de47352 is going to be created. [ 807.435283] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.435715] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.436013] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.436404] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.436779] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.438103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-16ede1ac-eef0-47ed-9daf-cbbf7de47352" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.518170] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.672032] env[63014]: INFO networking_nsxv3.common.synchronization [req-3d6b299b-9ba1-4cea-9519-e5298882486c req-0aee2ff4-ce2d-4793-abad-6210501eafe8 tempest-MultipleCreateTestJSON-401204873 tempest-MultipleCreateTestJSON-401204873-project-member] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 807.672032] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 807.672032] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.672032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.672032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.672032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.672032] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.672494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.672643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.672890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.673092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.673290] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.836426] env[63014]: INFO networking_nsxv3.common.synchronization [req-ca7114c1-7453-4a08-b725-3ef95b3e8724 req-8d44ecf1-ea75-4c53-8278-40be4a907f39 tempest-MultipleCreateTestJSON-401204873 tempest-MultipleCreateTestJSON-401204873-project-member] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 807.836961] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 807.837958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.837958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.023490] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.023490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.023490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.023490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.023490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.023490] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be updated. [ 808.049346] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.049696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.049816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.050218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.050404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.058905] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: IN_PROGRESS for 2s [ 808.175718] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.217522] env[63014]: INFO networking_nsxv3.common.synchronization [req-65ce9a27-8621-4131-97cf-d8a2e640f0bf req-a8513757-b497-4378-8fb7-29fec66b8619 service nova] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_rules [ 808.217764] env[63014]: INFO networking_nsxv3.common.synchronization [req-65ce9a27-8621-4131-97cf-d8a2e640f0bf req-a8513757-b497-4378-8fb7-29fec66b8619 service nova] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 808.217910] env[63014]: INFO networking_nsxv3.common.synchronization [req-65ce9a27-8621-4131-97cf-d8a2e640f0bf req-a8513757-b497-4378-8fb7-29fec66b8619 service nova] Enqueued Resource ID: 16ede1ac-eef0-47ed-9daf-cbbf7de47352 with Priority: HIGHEST for action port [ 808.218164] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_rules [ 808.218288] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 808.218393] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16ede1ac-eef0-47ed-9daf-cbbf7de47352 with Priority: HIGHEST for action port [ 808.219351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.219501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.219884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.219884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.219884] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.220840] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.220969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.221411] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-16ede1ac-eef0-47ed-9daf-cbbf7de47352 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.221411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16ede1ac-eef0-47ed-9daf-cbbf7de47352" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.221411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16ede1ac-eef0-47ed-9daf-cbbf7de47352" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.221681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16ede1ac-eef0-47ed-9daf-cbbf7de47352" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.221728] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16ede1ac-eef0-47ed-9daf-cbbf7de47352',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.680268] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.724089] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.724695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.724695] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16ede1ac-eef0-47ed-9daf-cbbf7de47352 with status ACTIVE [ 808.724695] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.724922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.724922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.725251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.725251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.725376] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.725376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.725460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.725601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.726040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.726040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.726040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.726040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.726233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.726233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.726298] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16ede1ac-eef0-47ed-9daf-cbbf7de47352 is going to be updated. [ 808.746547] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.747762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.747874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.749503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.749503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.749503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16ede1ac-eef0-47ed-9daf-cbbf7de47352" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.773982] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 808.774232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.774418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.774647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.774841] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.774954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.775031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.775194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.775279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.775392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.775523] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.855691] env[63014]: INFO networking_nsxv3.common.synchronization [req-c878957a-8d65-4c37-a60c-429a68664a6e req-716b7022-9010-4d60-9735-e1c62f55413b tempest-ServerRescueNegativeTestJSON-1204428609 tempest-ServerRescueNegativeTestJSON-1204428609-project-member] Enqueued Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_members [ 808.856280] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_members [ 808.856591] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b799ddde-e254-4e10-850e-ade205a5fd9b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.856736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.856803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.859886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.860092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.860271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.860349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.860542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.860637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.860734] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.065070] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 809.065318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.162901] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.163118] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.163470] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.163763] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.164046] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.164281] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.164474] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.165469] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.165469] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.165469] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.165469] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.165469] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.165469] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.165675] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 809.165699] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.169022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.183951] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.184134] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 809.184271] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.184462] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-385" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.184783] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-f00c862f-342e-4d84-aa03-379be520a904 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.184951] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-f00c862f-342e-4d84-aa03-379be520a904" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.185081] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-f00c862f-342e-4d84-aa03-379be520a904" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.185469] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-f00c862f-342e-4d84-aa03-379be520a904" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.185611] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f00c862f-342e-4d84-aa03-379be520a904',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.187073] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.187195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.187261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.187429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.187516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.187606] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 809.211574] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.211828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.211944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.212247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.212354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.222040] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 809.282420] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.282703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.282703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.282868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.283059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.283200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.283241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.283389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.283551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.283551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.283720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.283789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.283886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.283982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.284180] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.284242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.284285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.284493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.284570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.284624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.285294] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.363234] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.363234] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.363234] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.363234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.363726] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.367019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.367019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.367019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.367019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.367542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.367542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.367700] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b799ddde-e254-4e10-850e-ade205a5fd9b already deleted. [ 809.367794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.368405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.368844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.369019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.369120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.369183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.369326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.369401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.371089] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.688852] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.689171] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.689171] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.689470] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.689549] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.689704] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port f00c862f-342e-4d84-aa03-379be520a904 not found, creating... [ 809.689971] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.690148] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.690289] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.690518] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.690655] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.690943] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.691135] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.691268] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.691477] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.691610] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.691751] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: f00c862f-342e-4d84-aa03-379be520a904 is going to be created. [ 809.715472] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.715824] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.716028] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.716254] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.716492] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.716844] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-f00c862f-342e-4d84-aa03-379be520a904" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.717728] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.717847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.717914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.718116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.718220] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.788622] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ee7fd9b-59b4-4423-847c-b926a3ab5883: rpc.has_security_group_logging(os_id): False [ 809.804565] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.805291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.805291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.805291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.805291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.805513] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.805574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.805677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.805832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.805920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.806144] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.806258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.806334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.806527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.806610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.806790] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.808270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.808270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.808270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.808270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.808270] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be created. [ 809.872876] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.873023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.873099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.873329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.873514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.874712] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98c66d04-d431-433a-9b0a-4fec6e74caca: rpc.has_security_group_logging(os_id): False [ 809.875616] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.888776] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 809.893611] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.893611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.893611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.893611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.923691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.924091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.924243] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.924317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.924588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.924690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.925501] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.925501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.925501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.925501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.925501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.925697] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.925697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.925780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.925862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.925937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.926036] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 810.022481] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.022626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.022730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.022935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.023189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.069871] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: SUCCESS [ 810.070088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.070251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.070462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.070999] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.070999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.070999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.070999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.071174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.071174] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.073429] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 810.221109] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.378132] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.502805] env[63014]: INFO networking_nsxv3.common.synchronization [req-c878957a-8d65-4c37-a60c-429a68664a6e req-7195072e-4842-47ee-b216-87d1c8b64f02 service nova] Enqueued Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_rules [ 810.503085] env[63014]: INFO networking_nsxv3.common.synchronization [req-c878957a-8d65-4c37-a60c-429a68664a6e req-7195072e-4842-47ee-b216-87d1c8b64f02 service nova] Enqueued Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_members [ 810.503237] env[63014]: INFO networking_nsxv3.common.synchronization [req-c878957a-8d65-4c37-a60c-429a68664a6e req-7195072e-4842-47ee-b216-87d1c8b64f02 service nova] Enqueued Resource ID: f00c862f-342e-4d84-aa03-379be520a904 with Priority: HIGHEST for action port [ 810.503468] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_rules [ 810.503594] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_members [ 810.503689] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f00c862f-342e-4d84-aa03-379be520a904 with Priority: HIGHEST for action port [ 810.504486] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b799ddde-e254-4e10-850e-ade205a5fd9b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.504614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.504715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.504870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.504948] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.505743] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b799ddde-e254-4e10-850e-ade205a5fd9b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.505849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.505914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.506087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.506250] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.506343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.506406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.506558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.506628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.506713] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.507406] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f00c862f-342e-4d84-aa03-379be520a904 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.507721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f00c862f-342e-4d84-aa03-379be520a904" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.507721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f00c862f-342e-4d84-aa03-379be520a904" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.507721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f00c862f-342e-4d84-aa03-379be520a904" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.507830] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f00c862f-342e-4d84-aa03-379be520a904',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.574356] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.723478] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.882005] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.882274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.882362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.882618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.882717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.882821] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 810.909657] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.909865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.909940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.910319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.910506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.920358] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 811.009677] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.010856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b799ddde-e254-4e10-850e-ade205a5fd9b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.011035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.011432] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f00c862f-342e-4d84-aa03-379be520a904 with status ACTIVE [ 811.011547] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.011618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.011793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.012017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.012125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.012518] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.012518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.012677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.012773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.012773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.012964] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.013075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.013135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.013279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.013361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.013460] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f00c862f-342e-4d84-aa03-379be520a904 is going to be updated. [ 811.034537] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.034712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.034772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.034980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.035129] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.035373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f00c862f-342e-4d84-aa03-379be520a904" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.075847] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.226015] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 811.226129] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 811.228280] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 811.228487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.228649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.228856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.229049] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.229165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.229245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.229407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.229489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.229583] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.511721] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.579100] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.579262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.579335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.579591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.579692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.579794] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be updated. [ 811.625783] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.625979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.625979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.626683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.626683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.634882] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: IN_PROGRESS for 2s [ 811.732968] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.733428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.733428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.733490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.766056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.766056] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.766056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.766291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.766339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.766420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.766514] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 811.800740] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.800740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.800740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.800740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.800740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.812196] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 811.900689] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 811.900689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.018854] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.018930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.018970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.019172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.019265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.019356] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b799ddde-e254-4e10-850e-ade205a5fd9b is going to be created. [ 812.047175] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.047327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.048034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.048273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.048404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.057714] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b799ddde-e254-4e10-850e-ade205a5fd9b in Status: UNINITIALIZED for 2s [ 812.092934] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 812.092934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.092934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.092934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.092934] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.266281] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.266496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.266586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.266861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.280385] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 812.281755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.283695] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 812.312031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.312188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.312253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.312809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.321202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.321702] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 812.321885] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.321885] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 812.363249] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.363435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.363486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.363762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.364761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.364968] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 812.438152] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.438284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.438360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.438576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.438805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.439051] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 812.508177] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.508332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.508404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.508609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.508836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.509093] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 812.509238] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a1262ce7-9d69-4ee4-9458-d12053088d94', '5b44cf44-3516-4644-9659-498297843d9a', '4ee7fd9b-59b4-4423-847c-b926a3ab5883', 'c39243da-04ef-4faa-894b-970a67152377', 'ef90f51b-2d80-447d-910c-f5ca10a227fb', '546a1fbc-63de-4ead-af89-1f218af29386', '7989ce3f-24d4-41ad-b400-9895be68ebe4', 'efd91700-654d-4bc1-8b27-185db0eb3543', 'db4cd683-9721-46bf-9f15-99f7cf241691', '69b3470e-796f-409b-8367-cd3cf14ca4fb', 'b31bea8a-6eb8-474e-9f80-c659e23a5477', 'd19bea52-b73c-4d06-87a2-c45103884998', 'b654582e-9aa5-4cb5-919f-974e7b4e9f66', '333e5887-ef6d-4e88-a132-91dc117462bb', 'e50835d8-af5a-48b2-b8ae-a4f696900f48', '0a5c90ff-575c-404c-9432-915836e29303', 'd3082e67-cc51-4dbb-a0f9-69738e0314d0', 'd46ba6da-2ed2-4606-ad13-bb35d32bcb52', '864e57d5-1404-49e7-b86e-6aa5865742d0', '8a204f6f-e771-4e85-aa7c-c93c90225b83', '1c9b8f59-0fe1-4382-ad8c-018641195651', '3ee9bfb9-a909-4897-ba13-1c6476ab4ce8', '619cffb4-27cb-425f-bcd2-3f3b163886dc', '7b79f694-9d2b-4c43-8cea-cdc6e6ac940a', '5ab69c49-5404-4dd4-a6d3-4fce8969088a', 'dcaf011c-cc1f-4e0b-b169-b433df9cce25', '8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08', '98c66d04-d431-433a-9b0a-4fec6e74caca', '8c3c5e73-32ea-4e2f-aecf-a8278a3549df', '67b29187-e991-47a0-93b3-5a8f6f288242', '24d80c6b-3ebf-4ee6-8524-63b081da521b', '9141a736-220e-4a6b-b407-916c87c8099c', '153c5776-28ea-4b88-b692-fc1ee145e6dc', '22d88dc5-1e20-4ce5-b224-a55bea6c2304', 'bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9', 'a7dcf68e-77c7-4c96-8393-9ad6248f6c31', '5c2e75af-7b53-4662-af96-bb7c5bccaeba', 'cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4', '549b1fb9-6c49-4106-8a22-052debb3b7f9', 'ab84161a-cc47-4bb7-8bc3-f695a8be1c0a', '4362ce77-85ac-42be-8249-4cf8afc1e957'} {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.509327] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 812.527542] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.527692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.527763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.528070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.528434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.528434] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 812.528434] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.528601] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 812.593949] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.594128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.594204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.594558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.595601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.595935] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 812.596069] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 812.596215] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 812.596363] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 812.597033] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 812.597033] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGH for action security_group_rules [ 812.597033] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGH for action security_group_rules [ 812.597033] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGH for action security_group_rules [ 812.597033] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGH for action security_group_rules [ 812.597033] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGH for action security_group_rules [ 812.597257] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGH for action security_group_rules [ 812.597257] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGH for action security_group_rules [ 812.597358] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGH for action security_group_rules [ 812.597773] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGH for action security_group_rules [ 812.597773] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGH for action security_group_rules [ 812.597773] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGH for action security_group_rules [ 812.597773] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGH for action security_group_rules [ 812.597969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGH for action security_group_rules [ 812.597969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGH for action security_group_rules [ 812.597969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGH for action security_group_rules [ 812.597969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGH for action security_group_rules [ 812.598925] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGH for action security_group_rules [ 812.598925] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGH for action security_group_rules [ 812.598925] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGH for action security_group_rules [ 812.598925] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGH for action security_group_rules [ 812.598925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.598925] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.598925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.931465] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 812.931750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.931877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.932166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.932384] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.932507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.932572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.932732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.932811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.932920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.932978] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.442720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.442914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.442990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.443231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.443404] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.443505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.443565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.443784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.443784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.443863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.444023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.444114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.444172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.444309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.444460] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.444553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.444609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.444753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.444816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.444894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.445015] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.580929] env[63014]: INFO networking_nsxv3.common.synchronization [req-29163e70-6b69-48ac-a1d8-10432847d5e9 req-b4d0851c-b1bf-414d-a2bf-53a05d6942fc tempest-ServersAdminNegativeTestJSON-817582727 tempest-ServersAdminNegativeTestJSON-817582727-project-member] Enqueued Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 813.581166] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGHEST for action security_group_members [ 813.581310] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1262ce7-9d69-4ee4-9458-d12053088d94 with Priority: HIGH for action security_group_rules [ 813.581412] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGH for action security_group_rules [ 813.581509] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 with Priority: HIGH for action security_group_rules [ 813.581601] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGH for action security_group_rules [ 813.581949] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGH for action security_group_rules [ 813.581949] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGH for action security_group_rules [ 813.581949] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 with Priority: HIGH for action security_group_rules [ 813.586398] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGH for action security_group_rules [ 813.586398] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 333e5887-ef6d-4e88-a132-91dc117462bb with Priority: HIGH for action security_group_rules [ 813.586513] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c90ff-575c-404c-9432-915836e29303 with Priority: HIGH for action security_group_rules [ 813.586673] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGH for action security_group_rules [ 813.725747] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGH for action security_group_rules [ 813.726027] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGH for action security_group_rules [ 813.726161] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb with Priority: HIGH for action security_group_rules [ 813.726279] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db4cd683-9721-46bf-9f15-99f7cf241691 with Priority: HIGH for action security_group_rules [ 813.726414] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGH for action security_group_rules [ 813.726516] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efd91700-654d-4bc1-8b27-185db0eb3543 with Priority: HIGH for action security_group_rules [ 813.726609] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef90f51b-2d80-447d-910c-f5ca10a227fb with Priority: HIGH for action security_group_rules [ 813.726727] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGH for action security_group_rules [ 813.726789] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39243da-04ef-4faa-894b-970a67152377 with Priority: HIGH for action security_group_rules [ 813.728285] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.728413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.728482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.728685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.728838] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.728965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.729048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.729215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.729300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.729391] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.730198] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a1262ce7-9d69-4ee4-9458-d12053088d94 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.730275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.730347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.730518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.730593] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a1262ce7-9d69-4ee4-9458-d12053088d94',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.731372] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.731479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.731545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.731690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.731784] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.732439] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7989ce3f-24d4-41ad-b400-9895be68ebe4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.732535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.732599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.732740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.735914] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7989ce3f-24d4-41ad-b400-9895be68ebe4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.735914] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.735914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.735914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.735914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.735914] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.735914] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.735914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.735914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.735914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.735914] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.736383] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.736473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.736503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.736628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.736691] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.737491] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.737613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.737679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.737827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.737946] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46ba6da-2ed2-4606-ad13-bb35d32bcb52',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.738991] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.739113] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.739177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.739324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.739395] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.740176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-333e5887-ef6d-4e88-a132-91dc117462bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.740279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.740344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.740530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.740603] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('333e5887-ef6d-4e88-a132-91dc117462bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.740821] env[63014]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 813.741459] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c90ff-575c-404c-9432-915836e29303 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.741568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.741634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.741843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.741927] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c90ff-575c-404c-9432-915836e29303',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.743038] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.743178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.744232] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.744340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.744404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.744552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.744631] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.745420] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.745526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.745591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.745738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.745806] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.746716] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69b3470e-796f-409b-8367-cd3cf14ca4fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.746805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.746874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.747033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.747105] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69b3470e-796f-409b-8367-cd3cf14ca4fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.747875] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db4cd683-9721-46bf-9f15-99f7cf241691 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.747985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.748461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.748461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.748461] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db4cd683-9721-46bf-9f15-99f7cf241691',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.749046] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.749181] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.749247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.749395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.749466] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.750323] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-efd91700-654d-4bc1-8b27-185db0eb3543 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.750429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.750495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.750653] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.750724] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('efd91700-654d-4bc1-8b27-185db0eb3543',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.751499] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef90f51b-2d80-447d-910c-f5ca10a227fb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.751606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.751670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.751819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.751898] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef90f51b-2d80-447d-910c-f5ca10a227fb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.752693] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.752795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.752861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.753022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.753091] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.753934] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c39243da-04ef-4faa-894b-970a67152377 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.754052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.754120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.754281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.754351] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c39243da-04ef-4faa-894b-970a67152377',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.754561] env[63014]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 813.775327] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: SUCCESS [ 813.775569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.777519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.777738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.777959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.778097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.778161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.780634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.780634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.780634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.780634] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.821368] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 813.821712] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 deletion is rescheduled due to dependency. [ 813.821712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.947150] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98c66d04-d431-433a-9b0a-4fec6e74caca: rpc.has_security_group_logging(os_id): False [ 813.964582] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.964717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.964788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.965009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.987022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.987282] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.987404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.987471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.987668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.987749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.987938] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.988468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.988468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.988468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.988468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.988468] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.988743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.988743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.988743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.988847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.988886] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 814.045977] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.046143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.046208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.046802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.046968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.061921] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 814.068530] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b799ddde-e254-4e10-850e-ade205a5fd9b in Status: SUCCESS [ 814.068740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.068900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.069131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.069322] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.069439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.069506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.069669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.069834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.069834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.069939] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.260039] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.260039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.260039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.260039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.260039] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.260424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.260424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.260927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.260927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.261023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.261477] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.262168] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.262283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.262358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.262531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.280592] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.280809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.281965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.282282] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.282468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.282578] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.282830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.282960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.283120] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb is going to be updated. [ 814.284225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.284539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.285897] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.286106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.286218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.286448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.286642] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.286810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.287014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.287150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.287266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.287360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.287532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.287639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.287698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.287846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.288017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.288122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.288202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.288343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.288419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.288499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.288587] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.289687] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.289794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.289855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.290010] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.290156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.290258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.290318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.290448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.290547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.290632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.290719] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.297366] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.297366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.297366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.297366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.297773] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.297773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.297773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.297937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.298062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.298167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.298281] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.299263] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.299362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.299434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.299641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.300228] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.300364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.300434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.300619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.300704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.300792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.300880] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.304609] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3082e67-cc51-4dbb-a0f9-69738e0314d0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.304745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.304806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.305042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.305213] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.305313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.305380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.305622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.305723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.305832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.305896] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.314597] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.314776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.314823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.315053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.315285] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.315425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.315506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.315696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.315802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.315870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.315956] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.325713] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.325809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.325881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.326188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.326355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.333485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.333621] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a1262ce7-9d69-4ee4-9458-d12053088d94 is going to be deleted. [ 814.336415] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.361965] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: IN_PROGRESS for 2s [ 814.362835] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.362974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.363055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.363279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.365363] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.365495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.369202] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.369441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.370591] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.370689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.371480] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.371565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.372363] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.372458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.375815] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.375940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.376715] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.376856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.377596] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.377733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.378463] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.378579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.379619] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 814.380061] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.380130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.380758] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 814.381173] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.381281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.382032] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 814.382506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.382623] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c90ff-575c-404c-9432-915836e29303 is going to be deleted. [ 814.383530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.383775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.404839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.404987] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef90f51b-2d80-447d-910c-f5ca10a227fb is going to be deleted. [ 814.405948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.406186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.421880] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.422333] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.428038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.428038] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be deleted. [ 814.429392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.429624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.456241] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.456392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.457810] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.457930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.459528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.459653] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: efd91700-654d-4bc1-8b27-185db0eb3543 is going to be deleted. [ 814.460648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.460881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.513078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.513078] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 is going to be deleted. [ 814.513769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.514164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.560995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.561176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.571611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.571766] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c39243da-04ef-4faa-894b-970a67152377 is going to be deleted. [ 814.572921] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.574551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.574850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.582601] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.582719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.600244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.600386] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db4cd683-9721-46bf-9f15-99f7cf241691 is going to be deleted. [ 814.601395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.601632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.653743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.653927] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 333e5887-ef6d-4e88-a132-91dc117462bb is going to be deleted. [ 814.654987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.655624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.655624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.655624] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb is going to be deleted. [ 814.656814] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.656916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.656985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.657184] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.657266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.657382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.657573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.657652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.714059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.714224] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46ba6da-2ed2-4606-ad13-bb35d32bcb52 is going to be deleted. [ 814.716026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.716320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.720028] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.720152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.746155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.746303] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7989ce3f-24d4-41ad-b400-9895be68ebe4 is going to be deleted. [ 814.747270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.747513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.747602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.747725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a1262ce7-9d69-4ee4-9458-d12053088d94" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.747882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.748052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.748141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.748244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c90ff-575c-404c-9432-915836e29303" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.748738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.749115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.749215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.749351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef90f51b-2d80-447d-910c-f5ca10a227fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.749463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.749633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.749710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.749829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.749953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.750114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.750187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.750297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-efd91700-654d-4bc1-8b27-185db0eb3543" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.750420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.750564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.760863] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.760863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.765312] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.765447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.765515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.765710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.765867] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.765966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.766041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.766189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.766275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.766359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.766516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.766611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.766673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.766842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.766983] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.767087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.767146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.767296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.767382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.767546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.767637] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.793166] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b654582e-9aa5-4cb5-919f-974e7b4e9f66: rpc.has_security_group_logging(os_id): False [ 814.794459] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.807802] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.809576] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.809732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.809980] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.814354] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.814540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.815575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.815730] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be deleted. [ 814.816857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.817151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.817297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.817487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c39243da-04ef-4faa-894b-970a67152377" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.818734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.818978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.819122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.819305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.819978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.820213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.820338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.820503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db4cd683-9721-46bf-9f15-99f7cf241691" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.820988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.821383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.821530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.821699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-333e5887-ef6d-4e88-a132-91dc117462bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.823435] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.823590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.823706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.823914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.824055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.824225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46ba6da-2ed2-4606-ad13-bb35d32bcb52" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.825939] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.826057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.826667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.826667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.832108] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.832231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.832324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.832540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.832719] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.832829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.832924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.833103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.833220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.833334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.833569] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.833763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.833894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.834139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.834427] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.834631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.834680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.834920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.835062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.835162] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.835297] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.843832] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3082e67-cc51-4dbb-a0f9-69738e0314d0: rpc.has_security_group_logging(os_id): False [ 814.902789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.903213] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.903424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.903552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.903834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.903991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.904283] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.904479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.904597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.904852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.904992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.906476] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.906476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.906476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.906476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.906476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.906476] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be updated. [ 814.908401] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.908574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.908719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.908960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.930217] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.930375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.959700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.960230] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.960230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.960230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.960384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.960471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.960571] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 is going to be updated. [ 814.961739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.961923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.962016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.962131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7989ce3f-24d4-41ad-b400-9895be68ebe4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.964810] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.964969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.965031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.965200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.965282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.965426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.066464] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.066637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.066706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.066971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.067151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.077434] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b799ddde-e254-4e10-850e-ade205a5fd9b: rpc.has_security_group_logging(os_id): False [ 815.108889] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: IN_PROGRESS for 2s [ 815.111016] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.111016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.111016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.111016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.111016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.117830] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.118760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.118760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.118760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.118760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.119073] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.119190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.119255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.119430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.119520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.119634] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b799ddde-e254-4e10-850e-ade205a5fd9b is going to be created. [ 815.139490] env[63014]: INFO networking_nsxv3.common.synchronization [req-5ba09653-be28-4a59-ad58-236c325c6a52 req-2da33a8c-8be0-4f62-bc59-a6b03302d3b9 tempest-ListImageFiltersTestJSON-1238518118 tempest-ListImageFiltersTestJSON-1238518118-project-member] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 815.140072] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 815.141068] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.141204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.141268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.141473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.141636] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.141729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.141787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.141929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.142042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.142116] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.163473] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: IN_PROGRESS for 2s [ 815.265136] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 815.265983] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.268648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.268648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.268648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.268648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.271245] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ee7fd9b-59b4-4423-847c-b926a3ab5883: rpc.has_security_group_logging(os_id): False [ 815.285375] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b799ddde-e254-4e10-850e-ade205a5fd9b in Status: IN_PROGRESS for 2s [ 815.294635] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.297021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.297021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.297021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.297953] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 546a1fbc-63de-4ead-af89-1f218af29386: rpc.has_security_group_logging(os_id): False [ 815.311420] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b44cf44-3516-4644-9659-498297843d9a: rpc.has_security_group_logging(os_id): False [ 815.312746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d19bea52-b73c-4d06-87a2-c45103884998: rpc.has_security_group_logging(os_id): False [ 815.326090] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.326292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.327553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.328874] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.328874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.328874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.328874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.328874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.328874] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.329172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.329172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.329227] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.329328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.329561] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.329669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.329755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.329929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.330040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.330185] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 815.331604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.331802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.333784] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.333887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.337014] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b31bea8a-6eb8-474e-9f80-c659e23a5477: rpc.has_security_group_logging(os_id): False [ 815.348597] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.348756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.364156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.364274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.368938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.369242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.369355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.369417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.369717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.369808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.369907] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 is going to be updated. [ 815.370984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.371191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.404100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.404100] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.404100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.404100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.404434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.404579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.404746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d19bea52-b73c-4d06-87a2-c45103884998 is going to be updated. [ 815.406639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.406887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.472865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.473202] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.473328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.473432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.474258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.474258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.474258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.474258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.474258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.474258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.474258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.474584] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.474664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.474664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.474848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.474959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.474990] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 815.476542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.476727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.478567] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.478699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.481369] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.481483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.502242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.502677] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.502808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.502874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.503106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.503189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.503333] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be updated. [ 815.508035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.508035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.508035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.508035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.508035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.508035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.512411] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.512566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.512680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.512777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.512903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.535248] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546a1fbc-63de-4ead-af89-1f218af29386 in Status: IN_PROGRESS for 2s [ 815.551318] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 815.557842] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d19bea52-b73c-4d06-87a2-c45103884998 in Status: IN_PROGRESS for 2s [ 815.597167] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.597479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.597567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.597803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.597961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.644816] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.687184] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.687357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.687409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.687600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.687747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.712828] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 815.723465] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 2s [ 816.080040] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 816.080373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.146564] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.379885] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb in Status: SUCCESS [ 816.380112] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69b3470e-796f-409b-8367-cd3cf14ca4fb deletion is rescheduled due to dependency. [ 816.380231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69b3470e-796f-409b-8367-cd3cf14ca4fb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.648970] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.649190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.649268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.649515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.649631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.649742] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 is going to be updated. [ 816.680039] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.680134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.680169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.680379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.680527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.689650] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: IN_PROGRESS for 2s [ 817.122294] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: SUCCESS [ 817.122557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.123778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.123778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.123778] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.176916] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: SUCCESS [ 817.177157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.299042] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b799ddde-e254-4e10-850e-ade205a5fd9b in Status: SUCCESS [ 817.299299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.545957] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 546a1fbc-63de-4ead-af89-1f218af29386 in Status: SUCCESS [ 817.546453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.565059] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 817.565059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.568360] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d19bea52-b73c-4d06-87a2-c45103884998 in Status: SUCCESS [ 817.568602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.627153] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.627153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.627303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.627723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.627723] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.627723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.627863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.627986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.628073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.628177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.628273] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.732036] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 817.732126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.734125] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 817.734317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.131567] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.131788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.131788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.132493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.132493] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.132578] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.132609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.132987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.133101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.133412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.133578] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.133690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.133775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.133960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.134196] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.134439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.134439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.134510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.134851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.134851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.134851] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.637438] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b654582e-9aa5-4cb5-919f-974e7b4e9f66: rpc.has_security_group_logging(os_id): False [ 818.654906] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.655064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.655154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.655368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.655457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.655670] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.655765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.655824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.655971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.656075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.656270] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.656365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.656428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.656572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.656651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.656850] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.656943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.657016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.657422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.657510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.657608] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be updated. [ 818.698196] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: SUCCESS [ 818.698425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.717913] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.718083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.718163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.718353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.718501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.733254] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: IN_PROGRESS for 2s [ 819.016019] env[63014]: INFO networking_nsxv3.common.synchronization [req-a49649be-19b0-48d6-8551-9f26e3eab6be req-a9177caf-a99c-4306-897d-2e8b89ece4fc tempest-ServersAdminTestJSON-1268263957 tempest-ServersAdminTestJSON-1268263957-project-member] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 819.016402] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 819.016706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.016856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.016890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.017956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.017956] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.017956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.017956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.018261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.018261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.018261] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.526890] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.029676] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.532236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.532540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.532611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.532842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.532955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.533048] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 820.562477] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.562632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.562691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.562903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.563329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.571495] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 820.744060] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: SUCCESS [ 820.744295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.560164] env[63014]: INFO networking_nsxv3.common.synchronization [req-7c305d30-c743-47c4-9bc6-9386a9ad1a95 req-1fad2617-b792-4ef8-aaf4-94627854a4cb tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_members [ 821.560501] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_members [ 821.560980] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.560980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.560980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.561203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.561330] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.561439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.561498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.562220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.562220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.562220] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.859016] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.859016] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.859016] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.859016] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.859016] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.859341] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.859341] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.859476] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.859592] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.859801] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.859914] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.860036] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.860147] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.860259] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.860374] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.860510] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.881047] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.881227] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.881370] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.881543] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.881881] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-c97f936f-7a36-45e0-bc41-16ab03813fb3 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.882164] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-c97f936f-7a36-45e0-bc41-16ab03813fb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.882258] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-c97f936f-7a36-45e0-bc41-16ab03813fb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.882586] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-c97f936f-7a36-45e0-bc41-16ab03813fb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.882732] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c97f936f-7a36-45e0-bc41-16ab03813fb3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.064480] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.064681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.064744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.065120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.065251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.065436] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.065533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.065602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.065820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.065897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.066076] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e already deleted. [ 822.066166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.385176] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.385885] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.385885] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.385885] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.386042] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.386180] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port c97f936f-7a36-45e0-bc41-16ab03813fb3 not found, creating... [ 822.386482] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.386728] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.386728] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.386972] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.387338] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.387447] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.387607] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.387726] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.387937] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.388724] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.388921] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: c97f936f-7a36-45e0-bc41-16ab03813fb3 is going to be created. [ 822.411100] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.412055] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.412055] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.412055] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.412055] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.412282] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-c97f936f-7a36-45e0-bc41-16ab03813fb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.516911] env[63014]: INFO networking_nsxv3.common.synchronization [req-f37bc682-1d4f-45c4-b6d3-3858083f38f4 req-1afdfaec-5dd0-430b-b2f9-f7f3124dc02e tempest-ImagesOneServerNegativeTestJSON-1556540069 tempest-ImagesOneServerNegativeTestJSON-1556540069-project-member] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 822.517465] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 822.518081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.518081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.518081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.518252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.518334] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.518431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.518493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.518636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.518722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.518815] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.587088] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 822.587386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.022915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.022915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.022915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.022915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.045114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.045114] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.045114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.045114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.045114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.045114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.045114] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 823.079185] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.079185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.079185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.079185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.079185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.085832] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 823.114135] env[63014]: INFO networking_nsxv3.common.synchronization [req-7c305d30-c743-47c4-9bc6-9386a9ad1a95 req-b1073a80-42e8-48ee-be3f-0aa41a55f831 service nova] Enqueued Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_rules [ 823.114135] env[63014]: INFO networking_nsxv3.common.synchronization [req-7c305d30-c743-47c4-9bc6-9386a9ad1a95 req-b1073a80-42e8-48ee-be3f-0aa41a55f831 service nova] Enqueued Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_members [ 823.114135] env[63014]: INFO networking_nsxv3.common.synchronization [req-7c305d30-c743-47c4-9bc6-9386a9ad1a95 req-b1073a80-42e8-48ee-be3f-0aa41a55f831 service nova] Enqueued Resource ID: c97f936f-7a36-45e0-bc41-16ab03813fb3 with Priority: HIGHEST for action port [ 823.114135] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_rules [ 823.114782] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_members [ 823.115120] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c97f936f-7a36-45e0-bc41-16ab03813fb3 with Priority: HIGHEST for action port [ 823.118078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.118078] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.118078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.118078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.118078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.119099] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.120814] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-c97f936f-7a36-45e0-bc41-16ab03813fb3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.121270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c97f936f-7a36-45e0-bc41-16ab03813fb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.121617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c97f936f-7a36-45e0-bc41-16ab03813fb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.121912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c97f936f-7a36-45e0-bc41-16ab03813fb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.122153] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c97f936f-7a36-45e0-bc41-16ab03813fb3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.625141] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.627961] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.628589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.628817] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c97f936f-7a36-45e0-bc41-16ab03813fb3 with status ACTIVE [ 823.629115] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.629359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.629568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.629830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.630131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.631986] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.632139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.632172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.635522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.635522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.635522] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.635522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.635522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.635522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.635522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.635522] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c97f936f-7a36-45e0-bc41-16ab03813fb3 is going to be updated. [ 823.665395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.665395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.665395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.665708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.665773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.666322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c97f936f-7a36-45e0-bc41-16ab03813fb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.136642] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.640150] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.640451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.640451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.640938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.641081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.641218] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e is going to be created. [ 824.662843] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.662995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.663044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.663436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.663436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.679049] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e in Status: UNINITIALIZED for 2s [ 825.095743] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 825.095912] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 deletion is rescheduled due to dependency. [ 825.096035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.694744] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e in Status: SUCCESS [ 826.695161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.695628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.695856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.696063] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.696663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.696663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.696663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.696663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.696663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.696663] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.200189] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.702981] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e: rpc.has_security_group_logging(os_id): False [ 827.723897] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.723897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.723897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.723897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.723897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.724251] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.724368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.724432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.724660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.724748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.724842] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e is going to be created. [ 827.784761] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.784917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.784989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.785261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.785378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.796912] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e in Status: IN_PROGRESS for 2s [ 828.116154] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 828.116154] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 828.688976] env[63014]: INFO networking_nsxv3.common.synchronization [req-98df5ac4-68d7-43af-82f1-c1e8bfe66fdc req-4f6abccf-8938-411c-966b-cb074e1a3189 tempest-ServersWithSpecificFlavorTestJSON-1510674973 tempest-ServersWithSpecificFlavorTestJSON-1510674973-project-member] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 828.689733] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 828.689800] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.689914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.689980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.690193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.690664] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.690664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.690664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.690664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.690844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.690844] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.095858] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-111 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.096425] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-111" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.096425] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-111" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.096502] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-111" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.096726] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.096881] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.096998] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.097243] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.097376] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.097595] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.098795] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.098795] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.098795] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.098795] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 829.098795] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.098795] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.116996] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.117216] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 829.117320] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.117497] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-111" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.117892] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-fbecebf0-a110-49b7-93fc-f894108aaae9 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.118096] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-fbecebf0-a110-49b7-93fc-f894108aaae9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.118207] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-fbecebf0-a110-49b7-93fc-f894108aaae9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.118554] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-fbecebf0-a110-49b7-93fc-f894108aaae9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.118690] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbecebf0-a110-49b7-93fc-f894108aaae9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.192023] env[63014]: INFO networking_nsxv3.common.synchronization [None req-b2216faf-ac88-472c-b647-9831292f45db None None] Enqueued Resource ID: f545b730-148b-42a8-999b-f315c1bd6d6f with Priority: HIGHEST for action port [ 829.192023] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f545b730-148b-42a8-999b-f315c1bd6d6f with Priority: HIGHEST for action port [ 829.192023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f545b730-148b-42a8-999b-f315c1bd6d6f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.192023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f545b730-148b-42a8-999b-f315c1bd6d6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.192023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f545b730-148b-42a8-999b-f315c1bd6d6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.192023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f545b730-148b-42a8-999b-f315c1bd6d6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.192023] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f545b730-148b-42a8-999b-f315c1bd6d6f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.194570] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.194570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.194570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.194570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.194570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.194570] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.194570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.194570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.194570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.194969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.194969] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be deleted. [ 829.221153] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.221153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.221153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.221495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.221495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.221577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.623099] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.623351] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.623485] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.623800] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.623974] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.624160] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port fbecebf0-a110-49b7-93fc-f894108aaae9 not found, creating... [ 829.624451] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.624702] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.624854] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.625114] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.625263] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.625628] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.625901] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.626210] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.626505] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.626719] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.626978] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: fbecebf0-a110-49b7-93fc-f894108aaae9 is going to be created. [ 829.647602] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.647876] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.648047] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.654703] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.654703] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.654703] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-fbecebf0-a110-49b7-93fc-f894108aaae9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.696378] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f545b730-148b-42a8-999b-f315c1bd6d6f [ 829.697361] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.697361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.697361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.697361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.697361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.697361] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f545b730-148b-42a8-999b-f315c1bd6d6f already deleted. [ 829.697361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f545b730-148b-42a8-999b-f315c1bd6d6f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.808295] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e in Status: SUCCESS [ 829.808295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.594849] env[63014]: INFO networking_nsxv3.common.synchronization [req-98df5ac4-68d7-43af-82f1-c1e8bfe66fdc req-edaa3b96-93b5-4473-9489-832a2f6ba49b service nova] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_rules [ 830.595205] env[63014]: INFO networking_nsxv3.common.synchronization [req-98df5ac4-68d7-43af-82f1-c1e8bfe66fdc req-edaa3b96-93b5-4473-9489-832a2f6ba49b service nova] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 830.595511] env[63014]: INFO networking_nsxv3.common.synchronization [req-98df5ac4-68d7-43af-82f1-c1e8bfe66fdc req-edaa3b96-93b5-4473-9489-832a2f6ba49b service nova] Enqueued Resource ID: fbecebf0-a110-49b7-93fc-f894108aaae9 with Priority: HIGHEST for action port [ 830.596377] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_rules [ 830.596547] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 830.596748] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbecebf0-a110-49b7-93fc-f894108aaae9 with Priority: HIGHEST for action port [ 830.597019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.597151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.597207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.597417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.597496] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.598981] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.599115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.599187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.599372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.599630] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.599750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.599799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.599946] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.600052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.600145] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.601269] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbecebf0-a110-49b7-93fc-f894108aaae9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.601409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbecebf0-a110-49b7-93fc-f894108aaae9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.601498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbecebf0-a110-49b7-93fc-f894108aaae9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.603801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbecebf0-a110-49b7-93fc-f894108aaae9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.603896] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbecebf0-a110-49b7-93fc-f894108aaae9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.108581] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.108581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.108581] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.109695] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbecebf0-a110-49b7-93fc-f894108aaae9 with status ACTIVE [ 831.109887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.110029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.110109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.110334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.110428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.110614] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.110743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.110842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.110938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.112877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.113158] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.113287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.113357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.113523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.113701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.113752] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbecebf0-a110-49b7-93fc-f894108aaae9 is going to be updated. [ 831.133598] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.133598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.133598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.133598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.133892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.133892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbecebf0-a110-49b7-93fc-f894108aaae9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.616845] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.678184] env[63014]: INFO networking_nsxv3.common.synchronization [None req-33e42c1f-8670-4cb0-993f-a896a230f17a None None] Enqueued Resource ID: 44cb18b6-97c5-41e9-bb72-33b8c216159f with Priority: HIGHEST for action port [ 831.678739] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44cb18b6-97c5-41e9-bb72-33b8c216159f with Priority: HIGHEST for action port [ 831.682088] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-44cb18b6-97c5-41e9-bb72-33b8c216159f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.683337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44cb18b6-97c5-41e9-bb72-33b8c216159f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.684146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44cb18b6-97c5-41e9-bb72-33b8c216159f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.684545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44cb18b6-97c5-41e9-bb72-33b8c216159f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.684698] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44cb18b6-97c5-41e9-bb72-33b8c216159f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.119220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.119380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.119454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.119675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.119814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.119932] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be created. [ 832.143367] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.143367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.143367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.143367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.143367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.153212] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: UNINITIALIZED for 2s [ 832.187126] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44cb18b6-97c5-41e9-bb72-33b8c216159f [ 832.187417] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.187536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.187612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.187770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.187851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.187952] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44cb18b6-97c5-41e9-bb72-33b8c216159f already deleted. [ 832.188143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44cb18b6-97c5-41e9-bb72-33b8c216159f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.241197] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.241197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.241197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.241197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.241197] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.241197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.241197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.241197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.241882] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.242342] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.242620] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.242829] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.243047] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.243328] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 832.243905] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.244277] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.261961] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.265562] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 832.265562] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.265562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.265562] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-18e2ea98-76da-43b3-bab6-7673a7afb3bf taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.265562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.265562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.265562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.265562] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e2ea98-76da-43b3-bab6-7673a7afb3bf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.772135] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.772135] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.772135] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.772642] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.772642] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.773125] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.773316] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.773442] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.773694] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.773871] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.775357] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.775582] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.775727] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.775969] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.776148] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.776299] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 18e2ea98-76da-43b3-bab6-7673a7afb3bf is going to be updated. [ 832.798684] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.798684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.798684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.798684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.798684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.799517] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.559739] env[63014]: INFO networking_nsxv3.common.synchronization [req-898ef22e-51e1-45a2-bc59-6a2012f85048 req-33d35232-7123-42cf-93d0-729e814ca8e2 service nova] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_rules [ 833.559924] env[63014]: INFO networking_nsxv3.common.synchronization [req-898ef22e-51e1-45a2-bc59-6a2012f85048 req-33d35232-7123-42cf-93d0-729e814ca8e2 service nova] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_members [ 833.560091] env[63014]: INFO networking_nsxv3.common.synchronization [req-898ef22e-51e1-45a2-bc59-6a2012f85048 req-33d35232-7123-42cf-93d0-729e814ca8e2 service nova] Enqueued Resource ID: 18e2ea98-76da-43b3-bab6-7673a7afb3bf with Priority: HIGHEST for action port [ 833.562047] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_rules [ 833.562047] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_members [ 833.562047] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18e2ea98-76da-43b3-bab6-7673a7afb3bf with Priority: HIGHEST for action port [ 833.562047] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.562047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.562047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.562047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.562047] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.562595] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.562595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.562595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.562751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.562870] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.562932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.562993] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.563147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.563350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.563350] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.564319] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-18e2ea98-76da-43b3-bab6-7673a7afb3bf taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.564721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.564721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.564721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.564721] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18e2ea98-76da-43b3-bab6-7673a7afb3bf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.066236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.066523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.066558] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.069014] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18e2ea98-76da-43b3-bab6-7673a7afb3bf with status ACTIVE [ 834.069208] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.069339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.069377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.069576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.069663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.069835] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.069926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.069985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.070150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.070225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.070399] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.070487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.070545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.070681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.070753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.070832] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18e2ea98-76da-43b3-bab6-7673a7afb3bf is going to be updated. [ 834.090097] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.090235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.090306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.090499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.090631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.090783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18e2ea98-76da-43b3-bab6-7673a7afb3bf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.161319] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: SUCCESS [ 834.161547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.161703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.161916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.162119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.162315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.162315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.162449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.162528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.162611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.162698] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.574418] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.665469] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.023794] env[63014]: INFO networking_nsxv3.common.synchronization [req-bd8b6ed2-2a56-4584-896a-841ceff2233c req-8b797deb-3945-490e-9a09-94795b0e999a tempest-ServerRescueTestJSON-1023946604 tempest-ServerRescueTestJSON-1023946604-project-member] Enqueued Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 835.024338] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 835.024689] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.027875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.027875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.027875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.027875] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.027875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.027875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.027875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.027875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.027875] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.079356] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.079688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.079752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.079928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.080035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.080139] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 is going to be updated. [ 835.167502] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 864e57d5-1404-49e7-b86e-6aa5865742d0: rpc.has_security_group_logging(os_id): False [ 835.179995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.180394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.180497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.180761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.180929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.185694] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.185905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.185945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.186229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.186359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.186721] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.187495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.187495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.187495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.187495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.187495] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be created. [ 835.189280] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: IN_PROGRESS for 2s [ 835.256365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.256365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.256365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.256365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.256365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.273314] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: IN_PROGRESS for 2s [ 835.525538] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-633 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.525808] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-633" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.525939] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-633" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.526274] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-633" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.526546] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.527315] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.527315] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.527457] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.527552] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.527773] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.527896] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.528268] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.528268] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.528268] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.528394] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.528499] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.529898] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.547262] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.547484] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.547728] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.547892] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-633" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.548281] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-b7d97801-82bc-4e13-a076-76bac0db7789 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.548577] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-b7d97801-82bc-4e13-a076-76bac0db7789" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.548733] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-b7d97801-82bc-4e13-a076-76bac0db7789" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.549111] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-b7d97801-82bc-4e13-a076-76bac0db7789" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.549306] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7d97801-82bc-4e13-a076-76bac0db7789',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.983302] env[63014]: INFO networking_nsxv3.common.synchronization [req-3ac68855-920c-403c-876e-fd48d86fbc78 req-4cdfcf30-610f-4e2a-97fa-d059dd715935 tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 835.983609] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 835.983930] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.984079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.984164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.984369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.984550] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.984658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.984719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.984866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.984983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.985060] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.032164] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.052048] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.052294] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.052428] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.052718] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.052875] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.053047] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port b7d97801-82bc-4e13-a076-76bac0db7789 not found, creating... [ 836.053357] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.053519] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.053641] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.053864] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.054025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.054318] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.054477] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.054634] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.054894] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.055072] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.055235] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: b7d97801-82bc-4e13-a076-76bac0db7789 is going to be created. [ 836.075700] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.075839] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.075893] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.076197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.076457] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.076707] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-b7d97801-82bc-4e13-a076-76bac0db7789" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.487043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.487329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.487372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.487675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.487783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.488031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.488135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.488198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.488354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.488434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.488524] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 836.518767] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.518953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.519026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.519237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.519361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.534436] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.534618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.534686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.534903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.534989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.535102] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 is going to be updated. [ 836.538380] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 836.564257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.564394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.564463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.564710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.564856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.576232] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: IN_PROGRESS for 2s [ 836.819213] env[63014]: INFO networking_nsxv3.common.synchronization [req-bd8b6ed2-2a56-4584-896a-841ceff2233c req-86235062-c8f0-476e-a9c6-5180cce160a2 service nova] Enqueued Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_rules [ 836.819399] env[63014]: INFO networking_nsxv3.common.synchronization [req-bd8b6ed2-2a56-4584-896a-841ceff2233c req-86235062-c8f0-476e-a9c6-5180cce160a2 service nova] Enqueued Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 836.819540] env[63014]: INFO networking_nsxv3.common.synchronization [req-bd8b6ed2-2a56-4584-896a-841ceff2233c req-86235062-c8f0-476e-a9c6-5180cce160a2 service nova] Enqueued Resource ID: b7d97801-82bc-4e13-a076-76bac0db7789 with Priority: HIGHEST for action port [ 836.819769] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_rules [ 836.819899] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 836.819997] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7d97801-82bc-4e13-a076-76bac0db7789 with Priority: HIGHEST for action port [ 836.820560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.820696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.820775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.820992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.824413] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.825458] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.825560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.825763] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7d97801-82bc-4e13-a076-76bac0db7789 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.825914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7d97801-82bc-4e13-a076-76bac0db7789" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.825981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7d97801-82bc-4e13-a076-76bac0db7789" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.826193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7d97801-82bc-4e13-a076-76bac0db7789" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.826258] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7d97801-82bc-4e13-a076-76bac0db7789',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.198239] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: SUCCESS [ 837.198464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.198636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.198864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.199053] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.199183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.199247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.199400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.199480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.199566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.199752] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.290028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: SUCCESS [ 837.290273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.333950] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.334125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.334368] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7d97801-82bc-4e13-a076-76bac0db7789 with status ACTIVE [ 837.334600] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.334734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.334849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.335116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.335208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.335417] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.335581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.335627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.335789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.335863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.336071] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.336167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.336228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.336373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.336447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.336532] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7d97801-82bc-4e13-a076-76bac0db7789 is going to be updated. [ 837.361991] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.362168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.362257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.362540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.362681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.362875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7d97801-82bc-4e13-a076-76bac0db7789" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.701536] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.204166] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a204f6f-e771-4e85-aa7c-c93c90225b83: rpc.has_security_group_logging(os_id): False [ 838.225085] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.225085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.225085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.225296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.225296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.225969] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.225969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.225969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.225969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.225969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.225969] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 is going to be created. [ 838.303943] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.304351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.304537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.304938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.305387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.337816] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: IN_PROGRESS for 2s [ 838.551641] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 838.551781] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 deletion is rescheduled due to dependency. [ 838.551837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.585283] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: SUCCESS [ 838.585550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.585787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.586012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.586203] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.587261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.587261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.587261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.587261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.587261] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.088966] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.593079] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.885215] env[63014]: INFO networking_nsxv3.common.synchronization [req-4d2747c9-91fe-420f-8b4e-1a0c5db1562e req-fd80df44-1de5-48b6-985e-f3ac9157c4f2 tempest-VolumesAdminNegativeTest-1905375078 tempest-VolumesAdminNegativeTest-1905375078-project-member] Enqueued Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGHEST for action security_group_members [ 839.885802] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGHEST for action security_group_members [ 839.886181] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.886307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.886379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.886693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.886866] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.886983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.887070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.887215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.887301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.887395] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.097501] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.097891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.097891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.098151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.098253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.098387] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 is going to be updated. [ 840.127403] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.127569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.127639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.127865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.127988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.143840] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: IN_PROGRESS for 2s [ 840.238575] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-869 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.238830] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-869" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.238959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-869" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.239250] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-869" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.239582] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.239810] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.239863] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.240822] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.241546] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.241877] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 840.243022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.243022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.243022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.243022] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 840.243022] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.243022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.267511] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.268233] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 840.268578] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.268924] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-869" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.269319] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-3706a954-a4a0-4437-a5b7-91cd6f41782c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.269512] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-3706a954-a4a0-4437-a5b7-91cd6f41782c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.269630] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-3706a954-a4a0-4437-a5b7-91cd6f41782c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.269985] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-3706a954-a4a0-4437-a5b7-91cd6f41782c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.270295] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3706a954-a4a0-4437-a5b7-91cd6f41782c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.361264] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: SUCCESS [ 840.361732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.391539] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.391853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.391916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.392246] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.392416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.392755] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.392921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.392921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.393126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.393196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.393295] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b already deleted. [ 840.393366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.777024] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.777024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.777024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.777024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.777024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.777024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 3706a954-a4a0-4437-a5b7-91cd6f41782c not found, creating... [ 840.777024] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.777024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.777024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.777959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.777959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.777959] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.777959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.777959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.778241] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.778241] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.778326] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 3706a954-a4a0-4437-a5b7-91cd6f41782c is going to be created. [ 840.801836] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.802139] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.802256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.802503] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.802775] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.804019] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-3706a954-a4a0-4437-a5b7-91cd6f41782c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.718935] env[63014]: INFO networking_nsxv3.common.synchronization [req-4d2747c9-91fe-420f-8b4e-1a0c5db1562e req-37227d89-2a9d-431d-a4f2-da76e47a6c54 service nova] Enqueued Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGHEST for action security_group_rules [ 841.719411] env[63014]: INFO networking_nsxv3.common.synchronization [req-4d2747c9-91fe-420f-8b4e-1a0c5db1562e req-37227d89-2a9d-431d-a4f2-da76e47a6c54 service nova] Enqueued Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGHEST for action security_group_members [ 841.721473] env[63014]: INFO networking_nsxv3.common.synchronization [req-4d2747c9-91fe-420f-8b4e-1a0c5db1562e req-37227d89-2a9d-431d-a4f2-da76e47a6c54 service nova] Enqueued Resource ID: 3706a954-a4a0-4437-a5b7-91cd6f41782c with Priority: HIGHEST for action port [ 841.723678] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGHEST for action security_group_rules [ 841.723810] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGHEST for action security_group_members [ 841.723971] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3706a954-a4a0-4437-a5b7-91cd6f41782c with Priority: HIGHEST for action port [ 841.724461] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.724722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.724798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.725307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.725477] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.726831] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.726831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.726831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.727302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.727438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.727562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.727630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.727802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.727889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.727987] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.729479] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-3706a954-a4a0-4437-a5b7-91cd6f41782c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.729656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3706a954-a4a0-4437-a5b7-91cd6f41782c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.729790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3706a954-a4a0-4437-a5b7-91cd6f41782c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.730027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3706a954-a4a0-4437-a5b7-91cd6f41782c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.730189] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3706a954-a4a0-4437-a5b7-91cd6f41782c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.034149] env[63014]: INFO networking_nsxv3.common.synchronization [None req-79d95ea6-6bc6-4aa1-80ab-57a6e0b09c7b None None] Enqueued Resource ID: fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1 with Priority: HIGHEST for action port [ 842.034839] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1 with Priority: HIGHEST for action port [ 842.035503] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.035682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.035754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.036744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.036899] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.068888] env[63014]: INFO networking_nsxv3.common.synchronization [req-628c0c29-dfcf-4f7f-9863-48b0e6db30d8 req-d55ba0bb-de0a-4225-b0ae-ee4fb3b29a8b tempest-ServersV294TestFqdnHostnames-2073531531 tempest-ServersV294TestFqdnHostnames-2073531531-project-member] Enqueued Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_members [ 842.069196] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGHEST for action security_group_members [ 842.069538] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.069707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.069779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.069991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.070271] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.070378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.070458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.070750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.070847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.070943] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.155194] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: SUCCESS [ 842.155194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.155194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.155194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.155194] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.155194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.155194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.155194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.155194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.155194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.155194] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.235029] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3706a954-a4a0-4437-a5b7-91cd6f41782c with status ACTIVE [ 842.235029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.235029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.235029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.235029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.235029] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3706a954-a4a0-4437-a5b7-91cd6f41782c is going to be updated. [ 842.236980] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.237294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.237564] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.259939] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.260145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.260193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.260422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.260566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.261312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3706a954-a4a0-4437-a5b7-91cd6f41782c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.541278] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1 [ 842.541517] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.541645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.541727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.541934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.542029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.542124] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1 already deleted. [ 842.542206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdbb15c9-c687-47b5-8ca3-b6c0a5660bc1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.575269] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.575269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.575269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.575269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.575269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.575269] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.575269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.575269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.575269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.575269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.575269] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d19bea52-b73c-4d06-87a2-c45103884998 is going to be updated. [ 842.605027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.605027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.605027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.605027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.605027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.611720] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d19bea52-b73c-4d06-87a2-c45103884998 in Status: IN_PROGRESS for 2s [ 842.657581] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.657581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.657843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.657898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.658056] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.658180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.658245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.658399] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.658485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.658570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.658748] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.658844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.660016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.660016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.660016] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.660016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.660016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.660016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.660016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.660016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.660016] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.741025] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.167494] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4: rpc.has_security_group_logging(os_id): False [ 843.175189] env[63014]: INFO networking_nsxv3.common.synchronization [req-2ea83ff5-ee51-45e3-9bf9-8f7b1562830d req-bd34194a-c651-41e0-8f15-3f49f47614c7 tempest-ServersNegativeTestJSON-729475527 tempest-ServersNegativeTestJSON-729475527-project-member] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 843.175778] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 843.176728] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.176899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.176969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.178012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.178012] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.178012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.178012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.178012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.178012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.178012] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.193474] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.193652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.193695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.193891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.226947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.227244] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.227433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.227520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.227742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.227823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.228056] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.228161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.228224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.228507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.228507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.228654] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.228751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.228810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.228952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.229329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.229402] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 is going to be updated. [ 843.245968] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.245968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.245968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.245968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.245968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.245968] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b is going to be created. [ 843.269482] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.269632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.269678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.269904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.270079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.288377] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b in Status: UNINITIALIZED for 2s [ 843.308717] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.308914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.309049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.309297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.309453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.327273] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: IN_PROGRESS for 2s [ 843.634009] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.634009] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.634009] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.634009] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.634009] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.634341] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.634341] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.634522] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.634710] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.635074] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.635074] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.635179] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.635287] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.635402] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.635509] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.635656] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.667990] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.667990] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.667990] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.667990] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.668462] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-511e472d-baef-4a26-9182-8d33dc08882b taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.668665] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-511e472d-baef-4a26-9182-8d33dc08882b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.668789] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-511e472d-baef-4a26-9182-8d33dc08882b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.669166] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-511e472d-baef-4a26-9182-8d33dc08882b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.669312] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('511e472d-baef-4a26-9182-8d33dc08882b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.682428] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.172204] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.172496] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.172623] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.173850] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.174043] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.174216] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 511e472d-baef-4a26-9182-8d33dc08882b not found, creating... [ 844.174510] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.174699] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.174825] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.175099] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.175249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.175563] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.175738] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.175861] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.176115] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.176228] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.176378] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 511e472d-baef-4a26-9182-8d33dc08882b is going to be created. [ 844.186081] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.200257] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.200612] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.200742] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.201035] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.201455] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.201530] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-511e472d-baef-4a26-9182-8d33dc08882b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.628431] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d19bea52-b73c-4d06-87a2-c45103884998 in Status: SUCCESS [ 844.628431] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d19bea52-b73c-4d06-87a2-c45103884998 deletion is rescheduled due to dependency. [ 844.628529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.691855] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.692034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.692084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.692316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.692547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.692547] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be updated. [ 844.724267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.724433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.724495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.724779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.724922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.739347] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 2s [ 844.825530] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d65e6b53-ecc2-463b-9aa4-458877955e84 None None] Enqueued Resource ID: 2fe08aab-09fb-4e7f-bc08-263d7ec18964 with Priority: HIGHEST for action port [ 844.826155] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe08aab-09fb-4e7f-bc08-263d7ec18964 with Priority: HIGHEST for action port [ 844.826494] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fe08aab-09fb-4e7f-bc08-263d7ec18964 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.826667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fe08aab-09fb-4e7f-bc08-263d7ec18964" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.826667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fe08aab-09fb-4e7f-bc08-263d7ec18964" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.827041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fe08aab-09fb-4e7f-bc08-263d7ec18964" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.827150] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fe08aab-09fb-4e7f-bc08-263d7ec18964',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.084019] env[63014]: INFO networking_nsxv3.common.synchronization [req-2ea83ff5-ee51-45e3-9bf9-8f7b1562830d req-2fad2af1-9ae8-4b1b-8173-3afdf7fb4e69 service nova] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_rules [ 845.084019] env[63014]: INFO networking_nsxv3.common.synchronization [req-2ea83ff5-ee51-45e3-9bf9-8f7b1562830d req-2fad2af1-9ae8-4b1b-8173-3afdf7fb4e69 service nova] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 845.084019] env[63014]: INFO networking_nsxv3.common.synchronization [req-2ea83ff5-ee51-45e3-9bf9-8f7b1562830d req-2fad2af1-9ae8-4b1b-8173-3afdf7fb4e69 service nova] Enqueued Resource ID: 511e472d-baef-4a26-9182-8d33dc08882b with Priority: HIGHEST for action port [ 845.084019] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_rules [ 845.084019] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 845.084019] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 511e472d-baef-4a26-9182-8d33dc08882b with Priority: HIGHEST for action port [ 845.084431] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.084602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.084602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.084808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.085058] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.086403] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.086526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.086698] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-511e472d-baef-4a26-9182-8d33dc08882b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.086808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-511e472d-baef-4a26-9182-8d33dc08882b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.086873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-511e472d-baef-4a26-9182-8d33dc08882b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.089063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-511e472d-baef-4a26-9182-8d33dc08882b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.089063] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('511e472d-baef-4a26-9182-8d33dc08882b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.295567] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b in Status: SUCCESS [ 845.295942] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.295982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.296692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.296692] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.296692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.296692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.296919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.296919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.296919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.297027] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.329127] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fe08aab-09fb-4e7f-bc08-263d7ec18964 [ 845.329346] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.329469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.329528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.329799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.329896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.330878] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fe08aab-09fb-4e7f-bc08-263d7ec18964 already deleted. [ 845.330878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fe08aab-09fb-4e7f-bc08-263d7ec18964" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.340926] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: SUCCESS [ 845.341159] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.587698] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.588322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.592104] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 511e472d-baef-4a26-9182-8d33dc08882b with status ACTIVE [ 845.592467] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.592668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.592743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.592947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.593050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.593234] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.593334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.593395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.593542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.593620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.593798] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.593890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.593950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.594102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.594184] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.594261] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 511e472d-baef-4a26-9182-8d33dc08882b is going to be updated. [ 845.620015] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.620015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.620015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.620015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.620015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.620015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-511e472d-baef-4a26-9182-8d33dc08882b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.799489] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.799667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.799746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.799994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.800193] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.800304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.800370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.800554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.800648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.800755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.800922] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.801040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.801106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.801269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.801421] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.801523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.801587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.801751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.801845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.801941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.802021] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.304870] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b: rpc.has_security_group_logging(os_id): False [ 846.321412] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.321559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.321632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.321847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.321936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.322994] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.322994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.322994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.322994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.322994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.322994] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.322994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.322994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.323306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.323306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.323306] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.323411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.323448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.323596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.323648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.323727] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b is going to be created. [ 846.375551] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.375747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.376508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.376508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.376508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.387507] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b in Status: IN_PROGRESS for 2s [ 846.749058] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 846.749058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.749189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.749341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.749531] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.749654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.749744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.749911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.749995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.750106] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.255470] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.632020] env[63014]: INFO networking_nsxv3.common.synchronization [req-f689cce7-7f63-4da9-93c6-b756bff88199 req-4c33c74e-cdf4-4a16-b838-39e7284ef082 tempest-ServersNegativeTestMultiTenantJSON-1634987804 tempest-ServersNegativeTestMultiTenantJSON-1634987804-project-member] Enqueued Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGHEST for action security_group_members [ 847.632810] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGHEST for action security_group_members [ 847.633443] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-58b78822-d387-4773-a568-316aa746de6a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.633694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.633844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.634174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.634483] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.634644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.634736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.634951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.635082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.635211] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.758861] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.025553] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-809 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.025763] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-809" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.025894] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-809" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.026612] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-809" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.026906] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.027104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.027281] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.027465] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.027617] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.028431] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.028431] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.028431] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.028431] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.028431] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 848.028431] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.028785] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.046800] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.047063] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 848.047247] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.047524] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-809" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.048288] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-ad838166-2a8c-404f-8a70-a72f3815c5ea taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.048531] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-ad838166-2a8c-404f-8a70-a72f3815c5ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.048677] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-ad838166-2a8c-404f-8a70-a72f3815c5ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.049036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-ad838166-2a8c-404f-8a70-a72f3815c5ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.049212] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad838166-2a8c-404f-8a70-a72f3815c5ea',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.141308] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.141733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.141733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.141834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.141865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.142071] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.142193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.142235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.142371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.142451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.142540] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58b78822-d387-4773-a568-316aa746de6a already deleted. [ 848.142677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.248613] env[63014]: INFO networking_nsxv3.common.synchronization [req-76e865af-48f9-4372-b379-366e52bfc7b7 req-33f45405-8ace-4ae1-8116-47e41d5113c3 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 848.249311] env[63014]: INFO networking_nsxv3.common.synchronization [req-76e865af-48f9-4372-b379-366e52bfc7b7 req-33f45405-8ace-4ae1-8116-47e41d5113c3 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGHEST for action security_group_members [ 848.249311] env[63014]: INFO networking_nsxv3.common.synchronization [req-76e865af-48f9-4372-b379-366e52bfc7b7 req-33f45405-8ace-4ae1-8116-47e41d5113c3 tempest-SecurityGroupsTestJSON-922797074 tempest-SecurityGroupsTestJSON-922797074-project-member] Enqueued Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 848.249463] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGHEST for action security_group_members [ 848.249593] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGHEST for action security_group_members [ 848.249690] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc with Priority: HIGHEST for action security_group_members [ 848.249959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.250099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.250166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.250356] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.250499] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.254019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.254019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3082e67-cc51-4dbb-a0f9-69738e0314d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.254019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.254019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.254019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-153c5776-28ea-4b88-b692-fc1ee145e6dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.254019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.254836] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.254836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.254836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.254836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.254836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.254836] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('153c5776-28ea-4b88-b692-fc1ee145e6dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.261666] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.261788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.262269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.262269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.262269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.262269] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be updated. [ 848.297027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.297221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.297221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.297401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.297527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.310286] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 2s [ 848.398519] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b in Status: SUCCESS [ 848.398755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.552015] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.552189] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.552189] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.552561] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.552761] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.552954] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port ad838166-2a8c-404f-8a70-a72f3815c5ea not found, creating... [ 848.553273] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.553493] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.553647] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.553900] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.554056] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.554345] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.554712] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.554876] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.555144] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.555352] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.555540] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: ad838166-2a8c-404f-8a70-a72f3815c5ea is going to be created. [ 848.575150] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.575367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.575501] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.575782] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.576065] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.576266] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-ad838166-2a8c-404f-8a70-a72f3815c5ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.756225] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.756553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.756553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.756682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.756781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.757028] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.757134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.757199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.757359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.757439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.757526] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be updated. [ 848.758692] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.758812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.758861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.759036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.759918] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.760024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.787301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.787585] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.787740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.787816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.788165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.788165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.788302] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc is going to be updated. [ 848.789206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.789881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.789881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.789881] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.789881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.789881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.790256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.790256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.790256] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 is going to be updated. [ 848.792685] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.792806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.792888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.793115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.793282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.805215] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: IN_PROGRESS for 2s [ 848.820907] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.821119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.821190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.821522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.821712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.823877] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.823877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.823877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.824147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.824147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.834097] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: IN_PROGRESS for 2s [ 848.834879] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: IN_PROGRESS for 2s [ 849.419254] env[63014]: INFO networking_nsxv3.common.synchronization [req-f689cce7-7f63-4da9-93c6-b756bff88199 req-2f38d493-8623-4168-ad34-e2316a23934c service nova] Enqueued Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGHEST for action security_group_rules [ 849.419495] env[63014]: INFO networking_nsxv3.common.synchronization [req-f689cce7-7f63-4da9-93c6-b756bff88199 req-2f38d493-8623-4168-ad34-e2316a23934c service nova] Enqueued Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGHEST for action security_group_members [ 849.419689] env[63014]: INFO networking_nsxv3.common.synchronization [req-f689cce7-7f63-4da9-93c6-b756bff88199 req-2f38d493-8623-4168-ad34-e2316a23934c service nova] Enqueued Resource ID: ad838166-2a8c-404f-8a70-a72f3815c5ea with Priority: HIGHEST for action port [ 849.420265] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGHEST for action security_group_rules [ 849.420460] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGHEST for action security_group_members [ 849.420583] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad838166-2a8c-404f-8a70-a72f3815c5ea with Priority: HIGHEST for action port [ 849.420918] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58b78822-d387-4773-a568-316aa746de6a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.424773] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.424773] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-58b78822-d387-4773-a568-316aa746de6a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.424773] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.424773] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.424773] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad838166-2a8c-404f-8a70-a72f3815c5ea taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.424773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad838166-2a8c-404f-8a70-a72f3815c5ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.425635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad838166-2a8c-404f-8a70-a72f3815c5ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.425635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad838166-2a8c-404f-8a70-a72f3815c5ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.425635] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad838166-2a8c-404f-8a70-a72f3815c5ea',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.927534] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-58b78822-d387-4773-a568-316aa746de6a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.927534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.927876] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.931771] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad838166-2a8c-404f-8a70-a72f3815c5ea with status ACTIVE [ 849.932017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.932146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.932212] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.932459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.932532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.932766] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.932871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.932930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.933118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.933193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.933405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.933482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.933599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.933692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.933761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.933856] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad838166-2a8c-404f-8a70-a72f3815c5ea is going to be updated. [ 849.954025] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.954025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.954025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.954309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.954379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.954536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad838166-2a8c-404f-8a70-a72f3815c5ea" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.320262] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 850.320580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.321404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.321404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.321404] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.321624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.321624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.321741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.321845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.321948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.322114] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.430104] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.815379] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98c66d04-d431-433a-9b0a-4fec6e74caca in Status: SUCCESS [ 850.815595] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca deletion is rescheduled due to dependency. [ 850.815701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.825269] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.825414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.825485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.825716] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.825897] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.826012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.826082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.826256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.826319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.826407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.826554] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.826658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.826730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.826880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.827035] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.827128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.827189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.827327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.827404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.827485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.827573] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.843691] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 in Status: SUCCESS [ 850.843860] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 deletion is rescheduled due to dependency. [ 850.843962] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.845127] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc in Status: SUCCESS [ 850.845302] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 153c5776-28ea-4b88-b692-fc1ee145e6dc deletion is rescheduled due to dependency. [ 850.845440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-153c5776-28ea-4b88-b692-fc1ee145e6dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.935048] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.935048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.935048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.935472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.935472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.935472] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58b78822-d387-4773-a568-316aa746de6a is going to be created. [ 850.957225] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.957225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.957225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.957225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.957225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.965747] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58b78822-d387-4773-a568-316aa746de6a in Status: UNINITIALIZED for 2s [ 851.329684] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 549b1fb9-6c49-4106-8a22-052debb3b7f9: rpc.has_security_group_logging(os_id): False [ 851.347528] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.347624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.347624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.347847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.366214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.366548] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.366736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.366879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.367141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.367264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.367518] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.367631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.367700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.367896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.368028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.368263] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.368404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.368502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.368658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.368763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.368875] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be updated. [ 851.435498] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.435498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.435498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.435784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.435889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.451064] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 2s [ 852.975044] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58b78822-d387-4773-a568-316aa746de6a in Status: SUCCESS [ 852.975316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.975424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.975787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.976034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.976174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.976294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.976415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.976503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.976595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.976687] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.465374] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 853.465621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.478208] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-58b78822-d387-4773-a568-316aa746de6a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.478362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.478430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.478642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.478815] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.478922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.478984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.479155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.479241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.479329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.479472] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-58b78822-d387-4773-a568-316aa746de6a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.479559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.479623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.479756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.479890] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.480019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.480048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.480183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.480340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.480401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.480548] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.987132] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58b78822-d387-4773-a568-316aa746de6a: rpc.has_security_group_logging(os_id): False [ 854.007144] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.007325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.007489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.007655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.007772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.008017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.008151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.008260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.008387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.008466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.008673] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.008789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.008854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.009163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.009163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.009377] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.009459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.009527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.009688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.009784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.009879] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58b78822-d387-4773-a568-316aa746de6a is going to be created. [ 854.099925] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.099925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.099925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.100970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.100970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.111296] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58b78822-d387-4773-a568-316aa746de6a in Status: IN_PROGRESS for 2s [ 854.421521] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 854.421621] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 854.985629] env[63014]: INFO networking_nsxv3.common.synchronization [req-1cbab18b-6c22-4485-8801-e84fb8ea7643 req-a5d2862a-46a1-4bb4-a237-6535040bca13 tempest-AttachVolumeTestJSON-1387786992 tempest-AttachVolumeTestJSON-1387786992-project-member] Enqueued Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_members [ 854.986474] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGHEST for action security_group_members [ 854.986856] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.986991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.987103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.987320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.987533] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.987594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.987627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.987774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.987857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.987947] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.491113] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.491306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.491394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.491635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.491739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.492219] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.492219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.492219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.492393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.492393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.492528] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 is going to be updated. [ 855.522487] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.522487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.522487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.522487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.522487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.530229] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546a1fbc-63de-4ead-af89-1f218af29386 in Status: IN_PROGRESS for 2s [ 856.123915] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58b78822-d387-4773-a568-316aa746de6a in Status: SUCCESS [ 856.123915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.018077] env[63014]: INFO networking_nsxv3.common.synchronization [None req-52a87023-1220-43a3-a12c-ca2a923c437d None None] Enqueued Resource ID: c0fe9b75-83ea-49c5-ac92-76069ec0ccc6 with Priority: HIGHEST for action port [ 857.018077] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0fe9b75-83ea-49c5-ac92-76069ec0ccc6 with Priority: HIGHEST for action port [ 857.018077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0fe9b75-83ea-49c5-ac92-76069ec0ccc6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.018077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0fe9b75-83ea-49c5-ac92-76069ec0ccc6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.018077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0fe9b75-83ea-49c5-ac92-76069ec0ccc6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.018413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0fe9b75-83ea-49c5-ac92-76069ec0ccc6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.018606] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0fe9b75-83ea-49c5-ac92-76069ec0ccc6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.136833] env[63014]: INFO networking_nsxv3.common.synchronization [req-605b31cd-50fa-410f-af39-18ca87c2293e req-516acb5c-8561-47dc-a8df-cec432ea137c tempest-VolumesAdminNegativeTest-1905375078 tempest-VolumesAdminNegativeTest-1905375078-project-member] Enqueued Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGHEST for action security_group_members [ 857.137415] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGHEST for action security_group_members [ 857.137713] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.137832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.137896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.138172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.138336] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.139039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.139039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.139039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.139039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.139039] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.520392] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0fe9b75-83ea-49c5-ac92-76069ec0ccc6 [ 857.520654] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.524019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.524019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.524019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.524019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.524019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0fe9b75-83ea-49c5-ac92-76069ec0ccc6 already deleted. [ 857.524019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0fe9b75-83ea-49c5-ac92-76069ec0ccc6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.544493] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 546a1fbc-63de-4ead-af89-1f218af29386 in Status: SUCCESS [ 857.544858] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 deletion is rescheduled due to dependency. [ 857.545069] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.642517] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.645327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.645327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.645327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.645327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.645327] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.645327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.645327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.645327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.645327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.645327] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b is going to be updated. [ 857.671804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.671804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.671804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.672047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.672224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.682305] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b in Status: IN_PROGRESS for 2s [ 858.688233] env[63014]: INFO networking_nsxv3.common.synchronization [req-54d92447-4d60-425f-9b02-d4ed8c6bebb1 req-8e15afdf-140a-4f15-b9bb-557cbf25d5e5 tempest-ServersNegativeTestJSON-729475527 tempest-ServersNegativeTestJSON-729475527-project-member] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 858.688793] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 858.689793] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.690129] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.690298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.692168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.692168] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.692168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.692168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.692168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.692168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.692168] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.998515] env[63014]: INFO networking_nsxv3.common.synchronization [req-471765b0-dee4-4f36-b85b-dbb5156ff4e5 req-24e446ae-981d-4def-9f32-6c660ba3b1d9 tempest-ListImageFiltersTestJSON-1238518118 tempest-ListImageFiltersTestJSON-1238518118-project-member] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 859.000007] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGHEST for action security_group_members [ 859.000339] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.000448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.000512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.000716] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.000869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.000968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.001045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.001237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.001288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.001366] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.128735] env[63014]: INFO networking_nsxv3.common.synchronization [None req-a3f4ecb3-65e2-459b-9993-6a9968c8a857 None None] Enqueued Resource ID: 00607e6e-16f1-4f09-be9d-4e3ecf61cd60 with Priority: HIGHEST for action port [ 859.128993] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00607e6e-16f1-4f09-be9d-4e3ecf61cd60 with Priority: HIGHEST for action port [ 859.129568] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-00607e6e-16f1-4f09-be9d-4e3ecf61cd60 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.129680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00607e6e-16f1-4f09-be9d-4e3ecf61cd60" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.129751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00607e6e-16f1-4f09-be9d-4e3ecf61cd60" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.130109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00607e6e-16f1-4f09-be9d-4e3ecf61cd60" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.130228] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00607e6e-16f1-4f09-be9d-4e3ecf61cd60',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.197768] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.507514] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.507693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.507768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.507995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.528711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.528978] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.529146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.529180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.530759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.530759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.530759] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 is going to be updated. [ 859.555195] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.555338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.556177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.556177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.556177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.564477] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: IN_PROGRESS for 2s [ 859.632481] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 00607e6e-16f1-4f09-be9d-4e3ecf61cd60 [ 859.632620] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.632755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.632819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.633053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.633137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.633236] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:00607e6e-16f1-4f09-be9d-4e3ecf61cd60 already deleted. [ 859.633317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00607e6e-16f1-4f09-be9d-4e3ecf61cd60" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.691898] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b in Status: SUCCESS [ 859.692200] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b deletion is rescheduled due to dependency. [ 859.692297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.699631] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.202434] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.202551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.202654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.202872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.202967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.203077] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be updated. [ 860.230783] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.230989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.231079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.231310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.231455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.240024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 2s [ 861.573274] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 in Status: SUCCESS [ 861.573554] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 deletion is rescheduled due to dependency. [ 861.573618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.034275] env[63014]: INFO networking_nsxv3.common.synchronization [req-c855ce10-74ae-4948-8983-046f442e0c6b req-2fac00b6-d1a6-4669-ac14-70decef19f87 tempest-ServersNegativeTestMultiTenantJSON-1634987804 tempest-ServersNegativeTestMultiTenantJSON-1634987804-project-member] Enqueued Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGHEST for action security_group_members [ 862.035339] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGHEST for action security_group_members [ 862.035442] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-58b78822-d387-4773-a568-316aa746de6a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.035508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.035540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.035759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.035933] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.036059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.036137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.036316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.036557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.036628] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.249774] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 862.249774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.539195] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.539195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.539195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.539408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.540084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.540084] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.540084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.540491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.540491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.540491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.540611] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58b78822-d387-4773-a568-316aa746de6a is going to be updated. [ 862.569780] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.569984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.570079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.570254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.570397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.579856] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58b78822-d387-4773-a568-316aa746de6a in Status: IN_PROGRESS for 2s [ 864.591586] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58b78822-d387-4773-a568-316aa746de6a in Status: SUCCESS [ 864.591883] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58b78822-d387-4773-a568-316aa746de6a deletion is rescheduled due to dependency. [ 864.592798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.452346] env[63014]: INFO networking_nsxv3.common.synchronization [req-373ce394-8035-4a2e-be35-f7e14b1de5ae req-befc1757-9df2-4818-a28d-4ab61f952542 tempest-ServersAdminTestJSON-1268263957 tempest-ServersAdminTestJSON-1268263957-project-member] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 865.453061] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGHEST for action security_group_members [ 865.453375] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.453503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.453569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.453790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.453948] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.454057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.454122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.454274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.454357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.454449] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.956709] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.957067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.957067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.957331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.957453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.957699] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.957839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.957908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.958132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.958241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.958347] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be updated. [ 865.985139] env[63014]: INFO networking_nsxv3.common.synchronization [req-f39cad58-94d4-444c-a873-0e0d2ac74c6b req-6bf90287-195f-4eee-9dc4-9532fe47e5c0 tempest-ServerRescueTestJSON-1023946604 tempest-ServerRescueTestJSON-1023946604-project-member] Enqueued Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 865.985427] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.985572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.985646] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.985857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.986013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.988313] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 865.988641] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.988773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.988849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.992019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.992019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.992019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.992019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.992019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.992019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.992019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.998891] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: IN_PROGRESS for 2s [ 866.492566] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.995116] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.497965] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.498162] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.498240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.498474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.498566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.498668] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 is going to be updated. [ 867.525536] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.525797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.525899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.526179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.526327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.535290] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: IN_PROGRESS for 2s [ 868.007671] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 in Status: SUCCESS [ 868.007671] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 deletion is rescheduled due to dependency. [ 868.008081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.544148] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: SUCCESS [ 869.544381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.989217] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 870.989462] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 874.803582] env[63014]: INFO networking_nsxv3.common.synchronization [req-c5853d90-d292-47de-aac4-9a339f28f46e req-cea52f14-3ba3-4e6b-a532-3c0062769bf7 tempest-ServerAddressesTestJSON-582281091 tempest-ServerAddressesTestJSON-582281091-project-member] Enqueued Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGHEST for action security_group_members [ 874.804140] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGHEST for action security_group_members [ 874.804441] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a07f521-fa55-49eb-99e1-95d44b468907 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.804568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.804639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.804940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.805123] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.805231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.805281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.805453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.805535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.805625] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.224381] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.224636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-259" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.224872] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-259" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.225278] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-259" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.226027] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.226027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.226027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.226259] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.226407] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.226668] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.229878] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.229878] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.229878] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.229878] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 875.229878] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.229878] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.247663] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.247840] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 875.247985] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.248180] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-259" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.248496] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-2d1b8ad2-59b0-4276-88a8-6387d929726d taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.248668] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-2d1b8ad2-59b0-4276-88a8-6387d929726d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.248831] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-2d1b8ad2-59b0-4276-88a8-6387d929726d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.249717] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-2d1b8ad2-59b0-4276-88a8-6387d929726d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.249717] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d1b8ad2-59b0-4276-88a8-6387d929726d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.307751] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.307938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.308024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.308249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.308386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.308537] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.308641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.308694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.308842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.309033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.309207] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a07f521-fa55-49eb-99e1-95d44b468907 already deleted. [ 875.309279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.754974] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.755092] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.756170] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.756170] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.756170] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.756170] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 2d1b8ad2-59b0-4276-88a8-6387d929726d not found, creating... [ 875.756332] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.756490] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.756866] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.756929] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.757176] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.757508] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.757684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.758361] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.758361] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.758361] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.758361] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 2d1b8ad2-59b0-4276-88a8-6387d929726d is going to be created. [ 875.777932] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.777932] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.777932] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.778215] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.778461] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.778710] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-2d1b8ad2-59b0-4276-88a8-6387d929726d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.606927] env[63014]: INFO networking_nsxv3.common.synchronization [req-c5853d90-d292-47de-aac4-9a339f28f46e req-4b031a13-1cd5-414f-bd2f-3e21b76e7e82 service nova] Enqueued Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGHEST for action security_group_rules [ 876.607188] env[63014]: INFO networking_nsxv3.common.synchronization [req-c5853d90-d292-47de-aac4-9a339f28f46e req-4b031a13-1cd5-414f-bd2f-3e21b76e7e82 service nova] Enqueued Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGHEST for action security_group_members [ 876.607331] env[63014]: INFO networking_nsxv3.common.synchronization [req-c5853d90-d292-47de-aac4-9a339f28f46e req-4b031a13-1cd5-414f-bd2f-3e21b76e7e82 service nova] Enqueued Resource ID: 2d1b8ad2-59b0-4276-88a8-6387d929726d with Priority: HIGHEST for action port [ 876.607560] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGHEST for action security_group_rules [ 876.607687] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGHEST for action security_group_members [ 876.607782] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1b8ad2-59b0-4276-88a8-6387d929726d with Priority: HIGHEST for action port [ 876.608351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a07f521-fa55-49eb-99e1-95d44b468907 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.608475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.608601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.608793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.608879] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.609732] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a07f521-fa55-49eb-99e1-95d44b468907 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.609847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.609914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.610095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.610242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.610334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.610395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.610535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.610619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.610709] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.611778] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d1b8ad2-59b0-4276-88a8-6387d929726d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.611887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d1b8ad2-59b0-4276-88a8-6387d929726d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.611959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d1b8ad2-59b0-4276-88a8-6387d929726d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.612192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d1b8ad2-59b0-4276-88a8-6387d929726d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.612269] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d1b8ad2-59b0-4276-88a8-6387d929726d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.113877] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a07f521-fa55-49eb-99e1-95d44b468907 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.114041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.114226] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.115208] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d1b8ad2-59b0-4276-88a8-6387d929726d with status ACTIVE [ 877.115395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.115504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.115567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.115823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.115971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.116264] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.116493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.116493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.116734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.116822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.117080] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.117268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.117343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.117601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.117601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.117706] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d1b8ad2-59b0-4276-88a8-6387d929726d is going to be updated. [ 877.140111] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.140308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.140308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.140509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.140642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.140823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d1b8ad2-59b0-4276-88a8-6387d929726d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.619957] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.126137] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.126284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.126359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.126571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.126660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.126759] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a07f521-fa55-49eb-99e1-95d44b468907 is going to be created. [ 878.149951] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.150174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.150174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.150408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.150570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.158705] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a07f521-fa55-49eb-99e1-95d44b468907 in Status: UNINITIALIZED for 2s [ 878.642241] env[63014]: INFO networking_nsxv3.common.synchronization [req-52db0355-3a73-411c-be88-8b499dd933c8 req-1433934f-eba0-416e-94f4-5535a41cc033 tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 878.642601] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 878.642970] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.644126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.644126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.644309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.644483] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.644596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.644663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.645021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.645138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.645249] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.147649] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.147948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.148034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.148320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.148368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.148551] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.148647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.148705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.148848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.148919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.149013] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 879.173551] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.174219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.174324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.175477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.175477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.184581] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 879.204362] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.204552] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.204677] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.205040] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.205311] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.205468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.205585] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.205831] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.205976] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.206274] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.206414] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.206548] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.206691] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.206839] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 879.207312] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.207312] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.224511] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.224681] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 879.225010] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.225230] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.225566] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-4c45dd66-90de-4543-afe2-596c84347bd8 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.229017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-4c45dd66-90de-4543-afe2-596c84347bd8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.229017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-4c45dd66-90de-4543-afe2-596c84347bd8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.229017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-4c45dd66-90de-4543-afe2-596c84347bd8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.229017] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c45dd66-90de-4543-afe2-596c84347bd8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.728953] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.729365] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.729365] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.729676] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.729837] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.730012] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 4c45dd66-90de-4543-afe2-596c84347bd8 not found, creating... [ 879.730297] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.730461] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.730582] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.730813] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.730969] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.731271] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.731535] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.731680] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.731897] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.732052] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.732199] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 4c45dd66-90de-4543-afe2-596c84347bd8 is going to be created. [ 879.754843] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.755166] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.755270] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.755581] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.755832] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.756091] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-4c45dd66-90de-4543-afe2-596c84347bd8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.169143] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a07f521-fa55-49eb-99e1-95d44b468907 in Status: SUCCESS [ 880.169404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.169595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.169845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.170083] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.170212] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.170280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.170459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.170562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.170650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.170745] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.660329] env[63014]: INFO networking_nsxv3.common.synchronization [req-52db0355-3a73-411c-be88-8b499dd933c8 req-b52c4193-44b2-48cf-9769-2b26c9f264ad service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 880.660329] env[63014]: INFO networking_nsxv3.common.synchronization [req-52db0355-3a73-411c-be88-8b499dd933c8 req-b52c4193-44b2-48cf-9769-2b26c9f264ad service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 880.660329] env[63014]: INFO networking_nsxv3.common.synchronization [req-52db0355-3a73-411c-be88-8b499dd933c8 req-b52c4193-44b2-48cf-9769-2b26c9f264ad service nova] Enqueued Resource ID: 4c45dd66-90de-4543-afe2-596c84347bd8 with Priority: HIGHEST for action port [ 880.660329] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 880.660329] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 880.660329] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c45dd66-90de-4543-afe2-596c84347bd8 with Priority: HIGHEST for action port [ 880.660329] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.665697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.666039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.666349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.667435] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.668723] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.670042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.670448] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c45dd66-90de-4543-afe2-596c84347bd8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.670888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c45dd66-90de-4543-afe2-596c84347bd8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.671903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c45dd66-90de-4543-afe2-596c84347bd8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.672206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c45dd66-90de-4543-afe2-596c84347bd8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.672380] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c45dd66-90de-4543-afe2-596c84347bd8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.675780] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a07f521-fa55-49eb-99e1-95d44b468907 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.676949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.677139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.677520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.678053] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.678289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.678525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.678814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.678996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.679184] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.679422] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a07f521-fa55-49eb-99e1-95d44b468907 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.681334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.681334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.681334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.681334] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.681334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.681334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.681334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.681334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.681334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.681334] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.067019] env[63014]: INFO networking_nsxv3.common.synchronization [req-bd35dd6c-d958-43df-b0c4-d0ba4a624e98 req-38c9322a-f3cb-4254-8615-e38294b46229 tempest-ServerActionsV293TestJSON-1713986573 tempest-ServerActionsV293TestJSON-1713986573-project-member] Enqueued Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_members [ 881.067596] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGHEST for action security_group_members [ 881.067907] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dcaf011c-cc1f-4e0b-b169-b433df9cce25 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.070574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.070574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.070574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.070574] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.070574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.070574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.070574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.070574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.070574] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.175548] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.175713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.175966] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c45dd66-90de-4543-afe2-596c84347bd8 with status ACTIVE [ 881.176179] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.176283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.176344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.176557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.176641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.176810] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.176902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.176972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.177131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.177200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.177384] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.177520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.177520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.177952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.177952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.177952] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c45dd66-90de-4543-afe2-596c84347bd8 is going to be updated. [ 881.186534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a07f521-fa55-49eb-99e1-95d44b468907: rpc.has_security_group_logging(os_id): False [ 881.197615] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 881.197792] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 deletion is rescheduled due to dependency. [ 881.197907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.198067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.198320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.198447] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.198556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.198698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.198797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.198852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.198933] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.203083] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.203230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.203272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.203444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.203526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.203702] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.203803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.203868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.204020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.204099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.204296] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.204396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.204460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.204585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.204660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.204870] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.204961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.205089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.205171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.205247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.205331] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a07f521-fa55-49eb-99e1-95d44b468907 is going to be created. [ 881.208054] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.208163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.208224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.208383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.208501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.208650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c45dd66-90de-4543-afe2-596c84347bd8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.273030] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.273190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.273258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.273506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.273932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.287879] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a07f521-fa55-49eb-99e1-95d44b468907 in Status: IN_PROGRESS for 2s [ 881.471138] env[63014]: INFO networking_nsxv3.common.synchronization [req-d4a68348-13db-482a-98f6-a92b3069545d req-0f5f7fc5-1da9-4fb7-afc2-8b09075a95ee tempest-ServersWithSpecificFlavorTestJSON-1510674973 tempest-ServersWithSpecificFlavorTestJSON-1510674973-project-member] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 881.471638] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGHEST for action security_group_members [ 881.471934] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.472059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.472118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.472310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.472452] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.472541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.472599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.472758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.472844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.472933] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.573302] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.573492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.573544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.574238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.604185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.604446] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.604560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.605064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.605064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.605064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.605064] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 is going to be updated. [ 881.642426] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.642426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.642426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.642734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.642912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.653731] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 in Status: IN_PROGRESS for 2s [ 881.704371] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.979657] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.979814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.979918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.980155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.980266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.980447] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.980886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.980958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.981194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.981282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.984030] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be updated. [ 882.007849] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.008221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.008221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.008315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.008380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.020205] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: IN_PROGRESS for 2s [ 882.208421] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.713375] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.713375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.713375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.713375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.713375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.713375] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 882.742121] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.742121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.742121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.742121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.742121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.749173] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 883.297378] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a07f521-fa55-49eb-99e1-95d44b468907 in Status: SUCCESS [ 883.298422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.664731] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 in Status: SUCCESS [ 883.664731] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 deletion is rescheduled due to dependency. [ 883.664731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.037018] env[63014]: INFO networking_nsxv3.common.synchronization [req-d73ba7b8-e779-4826-98a3-8aaf49ff5ad5 req-dfd0cd4d-efc6-476f-b068-7ef9e350789f tempest-InstanceActionsV221TestJSON-2038071880 tempest-InstanceActionsV221TestJSON-2038071880-project-member] Enqueued Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGHEST for action security_group_members [ 884.037534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 in Status: SUCCESS [ 884.037911] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 deletion is rescheduled due to dependency. [ 884.038172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.040989] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGHEST for action security_group_members [ 884.040989] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.040989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.040989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.040989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.040989] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.040989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.040989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.040989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.040989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.040989] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.547483] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-685 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.547806] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-685" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.547806] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-685" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.548270] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-685" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.550993] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.550993] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.550993] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.550993] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.550993] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.550993] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.550993] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.550993] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.550993] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.550993] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 884.550993] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.552149] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.553344] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.553625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.553625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.553759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.553759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.553930] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.554046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.554203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.554347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.554347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.554475] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 already deleted. [ 884.554475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.571203] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.571371] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 884.571507] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.571675] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-685" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.571982] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-76e767a8-b9af-4935-af88-e8b2e4de3f80 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.572173] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-76e767a8-b9af-4935-af88-e8b2e4de3f80" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.572292] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-76e767a8-b9af-4935-af88-e8b2e4de3f80" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.573415] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-76e767a8-b9af-4935-af88-e8b2e4de3f80" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.573415] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76e767a8-b9af-4935-af88-e8b2e4de3f80',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.824605] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 884.824605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.824605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.824605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.824605] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.824605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.824605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.824605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.824605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.824605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.824605] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.078113] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.078360] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.078487] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.078859] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.079015] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.079855] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 76e767a8-b9af-4935-af88-e8b2e4de3f80 not found, creating... [ 885.080233] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.080419] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.081380] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.081380] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.081380] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.081380] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.081606] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.082068] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.082590] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.082769] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.082952] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 76e767a8-b9af-4935-af88-e8b2e4de3f80 is going to be created. [ 885.102769] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.102968] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.103134] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.103458] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.103723] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.103962] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-76e767a8-b9af-4935-af88-e8b2e4de3f80" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.327493] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.327493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.327493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.327734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.328327] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.328327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.328327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.328327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.328327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.328741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.328741] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.328741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.328741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.328887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.328973] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.329127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.329241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.329424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.329497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.329577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.329663] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.831804] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ee7fd9b-59b4-4423-847c-b926a3ab5883: rpc.has_security_group_logging(os_id): False [ 885.848661] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.848842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.848897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.849161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.849292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.849527] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.849628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.849688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.849864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.849946] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.850186] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.850280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.850346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.850488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.850561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.850788] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.850921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.850979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.851279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.851363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.851454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 885.912728] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.912972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.912972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.913160] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.913309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.924531] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 886.512971] env[63014]: INFO networking_nsxv3.common.synchronization [req-d73ba7b8-e779-4826-98a3-8aaf49ff5ad5 req-17b837d9-2b27-406d-9ad6-beed7cba6866 service nova] Enqueued Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGHEST for action security_group_rules [ 886.513399] env[63014]: INFO networking_nsxv3.common.synchronization [req-d73ba7b8-e779-4826-98a3-8aaf49ff5ad5 req-17b837d9-2b27-406d-9ad6-beed7cba6866 service nova] Enqueued Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGHEST for action security_group_members [ 886.513399] env[63014]: INFO networking_nsxv3.common.synchronization [req-d73ba7b8-e779-4826-98a3-8aaf49ff5ad5 req-17b837d9-2b27-406d-9ad6-beed7cba6866 service nova] Enqueued Resource ID: 76e767a8-b9af-4935-af88-e8b2e4de3f80 with Priority: HIGHEST for action port [ 886.513890] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGHEST for action security_group_rules [ 886.513890] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGHEST for action security_group_members [ 886.513890] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76e767a8-b9af-4935-af88-e8b2e4de3f80 with Priority: HIGHEST for action port [ 886.514492] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.514842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.514842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.514959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.515026] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.519466] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.519587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.519655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.519842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.523172] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.523172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.523172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.523172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.523172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.523172] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.525675] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-76e767a8-b9af-4935-af88-e8b2e4de3f80 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.525675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76e767a8-b9af-4935-af88-e8b2e4de3f80" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.525675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76e767a8-b9af-4935-af88-e8b2e4de3f80" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.525801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76e767a8-b9af-4935-af88-e8b2e4de3f80" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.525872] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76e767a8-b9af-4935-af88-e8b2e4de3f80',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.790704] env[63014]: INFO networking_nsxv3.common.synchronization [req-5a80bdf3-4e97-4e6b-bff6-d65f485cee35 req-548a6958-d11b-4d63-bb22-32e0a2f4b5f2 tempest-MultipleCreateTestJSON-401204873 tempest-MultipleCreateTestJSON-401204873-project-member] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 886.791268] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 886.791794] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.791794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.792035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.792429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.795847] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.795847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.795847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.795847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.796168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.796833] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.031019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.031019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.031019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76e767a8-b9af-4935-af88-e8b2e4de3f80 with status ACTIVE [ 887.031019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.031019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.031019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.031839] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.031839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.031839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.031839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.031839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.031839] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76e767a8-b9af-4935-af88-e8b2e4de3f80 is going to be updated. [ 887.052928] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.052928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.052928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.052928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.052928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.052928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76e767a8-b9af-4935-af88-e8b2e4de3f80" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.299195] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.299430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.299557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.299784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.299892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.300125] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.300235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.300302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.300461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.300625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.300625] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be deleted. [ 887.329482] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.329482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.329606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.329727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.329828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.329930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.534559] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.646577] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.646849] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.647042] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.648074] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.648074] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.648074] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.651774] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.652368] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.652885] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.653870] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.654121] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.654267] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.654532] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.654790] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.654997] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.655454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.684142] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.684979] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 887.685459] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.685562] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.685967] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-859c26f7-61ce-493b-a260-6c118c883d77 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.686287] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-859c26f7-61ce-493b-a260-6c118c883d77" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.686425] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-859c26f7-61ce-493b-a260-6c118c883d77" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.686836] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-859c26f7-61ce-493b-a260-6c118c883d77" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.686940] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('859c26f7-61ce-493b-a260-6c118c883d77',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.939103] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 887.939103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.039881] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.039881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.039881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.039881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.039881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.039881] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 is going to be created. [ 888.064188] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.064654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.064654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.064654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.064940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.073985] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 in Status: UNINITIALIZED for 2s [ 888.193976] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.193976] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.194192] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.194422] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.194584] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.194801] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 859c26f7-61ce-493b-a260-6c118c883d77 not found, creating... [ 888.196636] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.196636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.196636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.196636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.196636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.196636] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.196636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.196964] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.196964] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.197455] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.197455] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 859c26f7-61ce-493b-a260-6c118c883d77 is going to be created. [ 888.219320] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.220508] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.220508] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.220508] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.220508] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.220508] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-859c26f7-61ce-493b-a260-6c118c883d77" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.721847] env[63014]: INFO networking_nsxv3.common.synchronization [req-d2160915-68bc-471e-9910-9f7983252fe6 req-9c8c3bb9-f1ae-4b9a-a904-59128687334c tempest-ServerAddressesTestJSON-582281091 tempest-ServerAddressesTestJSON-582281091-project-member] Enqueued Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGHEST for action security_group_members [ 888.722406] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGHEST for action security_group_members [ 888.722728] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a07f521-fa55-49eb-99e1-95d44b468907 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.723558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.723558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.724796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.724915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.725038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.725283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.725283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.725545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.725545] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.013149] env[63014]: INFO networking_nsxv3.common.synchronization [req-5a80bdf3-4e97-4e6b-bff6-d65f485cee35 req-571c46aa-6527-4ab2-9d48-c42f346e36fe tempest-MultipleCreateTestJSON-401204873 tempest-MultipleCreateTestJSON-401204873-project-member] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 889.013149] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 889.013149] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.013506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.013667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.014050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.014363] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.014600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.014755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.015055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.015241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.015416] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.048441] env[63014]: INFO networking_nsxv3.common.synchronization [req-5a80bdf3-4e97-4e6b-bff6-d65f485cee35 req-38985889-1e7f-421a-8a4a-4db909c5c0d6 service nova] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_rules [ 889.050202] env[63014]: INFO networking_nsxv3.common.synchronization [req-5a80bdf3-4e97-4e6b-bff6-d65f485cee35 req-38985889-1e7f-421a-8a4a-4db909c5c0d6 service nova] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 889.050202] env[63014]: INFO networking_nsxv3.common.synchronization [req-5a80bdf3-4e97-4e6b-bff6-d65f485cee35 req-38985889-1e7f-421a-8a4a-4db909c5c0d6 service nova] Enqueued Resource ID: 859c26f7-61ce-493b-a260-6c118c883d77 with Priority: HIGHEST for action port [ 889.053808] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_rules [ 889.053808] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 889.053808] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 859c26f7-61ce-493b-a260-6c118c883d77 with Priority: HIGHEST for action port [ 889.053808] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.053808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.053808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.053808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.053808] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.053808] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.053808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.053808] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-859c26f7-61ce-493b-a260-6c118c883d77 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.053808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-859c26f7-61ce-493b-a260-6c118c883d77" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.053808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-859c26f7-61ce-493b-a260-6c118c883d77" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.053808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-859c26f7-61ce-493b-a260-6c118c883d77" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.053808] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('859c26f7-61ce-493b-a260-6c118c883d77',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.228441] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.228592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.228663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.228890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.229125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.229208] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.229295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.229355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.231066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.231066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.231066] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a07f521-fa55-49eb-99e1-95d44b468907 is going to be updated. [ 889.257025] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.257025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.257025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.257025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.257025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.264927] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a07f521-fa55-49eb-99e1-95d44b468907 in Status: IN_PROGRESS for 2s [ 889.517898] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.555649] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.555814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.556045] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 859c26f7-61ce-493b-a260-6c118c883d77 with status ACTIVE [ 889.556229] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.556342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.556409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.556618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.556706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.556875] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.557026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.557077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.557233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.557314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.557497] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.557647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.557647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.558134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.558134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.558134] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 859c26f7-61ce-493b-a260-6c118c883d77 is going to be updated. [ 889.579847] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.580012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.580074] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.580281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.580421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.580583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-859c26f7-61ce-493b-a260-6c118c883d77" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.764130] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.764485] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.764485] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.764736] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.765050] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.765224] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.765350] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.765703] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.765800] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.766077] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.766159] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.766272] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.766383] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.766598] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.766598] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.766742] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.784616] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.784831] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 889.786112] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.786112] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-854" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.786112] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-2b6271ad-ff92-402b-b250-e75aab305d61 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.786112] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-2b6271ad-ff92-402b-b250-e75aab305d61" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.786112] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-2b6271ad-ff92-402b-b250-e75aab305d61" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.786458] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-2b6271ad-ff92-402b-b250-e75aab305d61" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.786551] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b6271ad-ff92-402b-b250-e75aab305d61',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.020122] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.088863] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 in Status: SUCCESS [ 890.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.088863] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.088863] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.293236] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.294580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.294580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.294948] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.295211] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.295466] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 2b6271ad-ff92-402b-b250-e75aab305d61 not found, creating... [ 890.296072] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.296365] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.296557] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.296978] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.297117] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.297529] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.297708] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.297896] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.298468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.299546] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.300117] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 2b6271ad-ff92-402b-b250-e75aab305d61 is going to be created. [ 890.322640] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.323019] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.323100] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.323365] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.323601] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.323855] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-2b6271ad-ff92-402b-b250-e75aab305d61" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.394357] env[63014]: INFO networking_nsxv3.common.synchronization [None req-df583dba-a837-4c3d-aac1-22f7f36391c6 tempest-AttachVolumeTestJSON-1387786992 tempest-AttachVolumeTestJSON-1387786992-project-member] Enqueued Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_rules [ 890.394357] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_rules [ 890.394357] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89a039f0-af50-4be6-96e7-c2a3698d5144 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.394357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.394357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.394680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.394680] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.464210] env[63014]: INFO networking_nsxv3.common.synchronization [None req-797e644f-bbab-4e69-ad2a-1794f743b6ea tempest-AttachVolumeTestJSON-1387786992 tempest-AttachVolumeTestJSON-1387786992-project-member] Enqueued Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_rules [ 890.464543] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_rules [ 890.464625] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89a039f0-af50-4be6-96e7-c2a3698d5144 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.464738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.522299] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.522427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.522476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.522690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.522784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.522886] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be created. [ 890.548100] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.548293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.548350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.548520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.548676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.557963] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: UNINITIALIZED for 2s [ 890.590483] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.590681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.590758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.590981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.591226] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.591332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.591393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.591549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.591639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.591728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.591873] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.591965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.592034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.592181] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.592319] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.592407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.592460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.593519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.593519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.593519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.593519] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.915803] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.917890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.918373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.919027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.919113] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.920219] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 already deleted. [ 890.920219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.920219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.920219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.920219] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.095292] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0: rpc.has_security_group_logging(os_id): False [ 891.111483] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.111632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.111702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.111955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.112136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.112427] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.112427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.112427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.112554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.112610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.112815] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.112911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.112972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.113196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.113273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.113466] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.113559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.113663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.113749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.113833] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.113898] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 is going to be created. [ 891.116812] env[63014]: INFO networking_nsxv3.common.synchronization [req-5a80bdf3-4e97-4e6b-bff6-d65f485cee35 req-f6e02e29-4f24-4080-bb9c-a02e6f81504e service nova] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_rules [ 891.116990] env[63014]: INFO networking_nsxv3.common.synchronization [req-5a80bdf3-4e97-4e6b-bff6-d65f485cee35 req-f6e02e29-4f24-4080-bb9c-a02e6f81504e service nova] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 891.117145] env[63014]: INFO networking_nsxv3.common.synchronization [req-5a80bdf3-4e97-4e6b-bff6-d65f485cee35 req-f6e02e29-4f24-4080-bb9c-a02e6f81504e service nova] Enqueued Resource ID: 2b6271ad-ff92-402b-b250-e75aab305d61 with Priority: HIGHEST for action port [ 891.117595] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_rules [ 891.117725] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 891.117819] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b6271ad-ff92-402b-b250-e75aab305d61 with Priority: HIGHEST for action port [ 891.118060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.118150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.118340] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.118419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.118593] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b6271ad-ff92-402b-b250-e75aab305d61 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.118685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b6271ad-ff92-402b-b250-e75aab305d61" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.118894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b6271ad-ff92-402b-b250-e75aab305d61" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.118894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b6271ad-ff92-402b-b250-e75aab305d61" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.118963] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b6271ad-ff92-402b-b250-e75aab305d61',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.176227] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.176422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.176422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.176645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.176806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.191169] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 in Status: IN_PROGRESS for 2s [ 891.276343] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a07f521-fa55-49eb-99e1-95d44b468907 in Status: SUCCESS [ 891.276343] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a07f521-fa55-49eb-99e1-95d44b468907 deletion is rescheduled due to dependency. [ 891.276343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.442320] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.442554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.442554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.443207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.443207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.443207] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 already deleted. [ 891.443207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.620658] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b6271ad-ff92-402b-b250-e75aab305d61 with status ACTIVE [ 891.620658] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.620845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.620845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.621078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.621180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.621410] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.621520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.621579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.621841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.621923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.625029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.625029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.625029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.625029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.625029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.625029] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b6271ad-ff92-402b-b250-e75aab305d61 is going to be updated. [ 891.662426] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.662426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.662426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.662426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.662426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.662426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b6271ad-ff92-402b-b250-e75aab305d61" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.958855] env[63014]: INFO networking_nsxv3.common.synchronization [req-d681693d-e74c-4aad-9e4e-c97c70a9b326 req-876b32ed-c158-4332-bec9-c88c5ae0fe70 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 891.959442] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 891.960220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.960220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.960220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.961271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.961450] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.961559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.961623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.961835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.961949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.962062] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.044404] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d7ed978f-ba38-4fea-a993-ea63336be66b None None] Enqueued Resource ID: 0d77c634-6269-4ce5-8d5f-753c60cee3c1 with Priority: HIGHEST for action port [ 892.044958] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d77c634-6269-4ce5-8d5f-753c60cee3c1 with Priority: HIGHEST for action port [ 892.045387] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d77c634-6269-4ce5-8d5f-753c60cee3c1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.045679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d77c634-6269-4ce5-8d5f-753c60cee3c1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.045679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d77c634-6269-4ce5-8d5f-753c60cee3c1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.046111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d77c634-6269-4ce5-8d5f-753c60cee3c1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.046255] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d77c634-6269-4ce5-8d5f-753c60cee3c1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.468203] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.468203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.468761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.468761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.468761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.468761] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.469285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.469285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.469285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.469285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.469285] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 already deleted. [ 892.469285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.548644] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d77c634-6269-4ce5-8d5f-753c60cee3c1 [ 892.548946] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.549138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.549209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.549449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.549533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.549661] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d77c634-6269-4ce5-8d5f-753c60cee3c1 already deleted. [ 892.549733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d77c634-6269-4ce5-8d5f-753c60cee3c1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.576324] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 892.576324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.576518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.577124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.577351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.577591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.577657] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.577822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.577924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.578077] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.735482] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.735482] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.735482] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.737527] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.737937] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.738616] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.738956] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.739527] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.740161] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.744024] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.744024] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.744024] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.744024] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.744024] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.744024] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.744024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.760437] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.760437] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 892.760437] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.760437] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.760437] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-df0ed4bf-89aa-4594-b093-c124f70f91f3 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.760437] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-df0ed4bf-89aa-4594-b093-c124f70f91f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.760437] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-df0ed4bf-89aa-4594-b093-c124f70f91f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.760437] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-df0ed4bf-89aa-4594-b093-c124f70f91f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.760437] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0ed4bf-89aa-4594-b093-c124f70f91f3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.081754] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.209035] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 in Status: SUCCESS [ 893.209035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.264128] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.264500] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.264645] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.264997] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.265198] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.265367] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port df0ed4bf-89aa-4594-b093-c124f70f91f3 not found, creating... [ 893.265652] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.265821] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.265944] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.268783] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.269485] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.269989] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.271787] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.272634] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.272961] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.273250] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.273612] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: df0ed4bf-89aa-4594-b093-c124f70f91f3 is going to be created. [ 893.294789] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.295351] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.295351] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.295479] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.295989] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.295989] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-df0ed4bf-89aa-4594-b093-c124f70f91f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.518084] env[63014]: INFO networking_nsxv3.common.synchronization [req-977bc44e-a41d-4ffc-ab1d-836a7f479378 req-7bb99c5e-86d1-45c3-8a5a-81375c892077 tempest-AttachVolumeShelveTestJSON-960433482 tempest-AttachVolumeShelveTestJSON-960433482-project-member] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_members [ 893.519077] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGHEST for action security_group_members [ 893.519263] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.519403] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.519468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.519733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.519925] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.520037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.520037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.523024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.523024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.523024] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.587608] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.023567] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.023745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.023745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.023931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.024038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.025167] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.025167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.025167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.025167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.025167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.025167] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 is going to be updated. [ 894.052876] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.052876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.052876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.052876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.052876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.062400] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: IN_PROGRESS for 2s [ 894.093174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.094658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.094658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.094658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.094792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.094845] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 894.121628] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.122219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.122315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.122532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.122687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.132620] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 894.398185] env[63014]: INFO networking_nsxv3.common.synchronization [req-d681693d-e74c-4aad-9e4e-c97c70a9b326 req-1640d65c-b929-4ae9-b4f0-f5f21ece40da service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 894.398367] env[63014]: INFO networking_nsxv3.common.synchronization [req-d681693d-e74c-4aad-9e4e-c97c70a9b326 req-1640d65c-b929-4ae9-b4f0-f5f21ece40da service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 894.399107] env[63014]: INFO networking_nsxv3.common.synchronization [req-d681693d-e74c-4aad-9e4e-c97c70a9b326 req-1640d65c-b929-4ae9-b4f0-f5f21ece40da service nova] Enqueued Resource ID: df0ed4bf-89aa-4594-b093-c124f70f91f3 with Priority: HIGHEST for action port [ 894.399244] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 894.399344] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 894.399344] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df0ed4bf-89aa-4594-b093-c124f70f91f3 with Priority: HIGHEST for action port [ 894.399641] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.399758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.399821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.400891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.400891] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.401284] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.401363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.401426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.401727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.401858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.402053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.402174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.403572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.403572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.403572] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.403572] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-df0ed4bf-89aa-4594-b093-c124f70f91f3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.403572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df0ed4bf-89aa-4594-b093-c124f70f91f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.403572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df0ed4bf-89aa-4594-b093-c124f70f91f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.404050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df0ed4bf-89aa-4594-b093-c124f70f91f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.404050] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df0ed4bf-89aa-4594-b093-c124f70f91f3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.720582] env[63014]: INFO networking_nsxv3.common.synchronization [None req-f1408798-dc9b-4e36-ade5-41ee8417f509 None None] Enqueued Resource ID: 6d723f12-631f-46b9-8c4e-f48e6a5cbce6 with Priority: HIGHEST for action port [ 894.721668] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d723f12-631f-46b9-8c4e-f48e6a5cbce6 with Priority: HIGHEST for action port [ 894.722497] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d723f12-631f-46b9-8c4e-f48e6a5cbce6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.722497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d723f12-631f-46b9-8c4e-f48e6a5cbce6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.722497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d723f12-631f-46b9-8c4e-f48e6a5cbce6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.723140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d723f12-631f-46b9-8c4e-f48e6a5cbce6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.723140] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d723f12-631f-46b9-8c4e-f48e6a5cbce6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.886540] env[63014]: INFO networking_nsxv3.common.synchronization [None req-aeeeab2e-6569-4fad-91ce-5bb44b372148 tempest-ServersTestJSON-516703967 tempest-ServersTestJSON-516703967-project-member] Enqueued Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_rules [ 894.887604] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_rules [ 894.887956] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.888114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.888180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.888652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.888652] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.908119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.908119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.908119] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.908119] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df0ed4bf-89aa-4594-b093-c124f70f91f3 with status ACTIVE [ 894.908119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.908119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.908119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.908119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.908119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.908119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.908119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.909494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.909494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.909494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.909494] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.909494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.909494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.909494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.909494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.909494] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df0ed4bf-89aa-4594-b093-c124f70f91f3 is going to be updated. [ 894.930160] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.930319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.930390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.930743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.930743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.930958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df0ed4bf-89aa-4594-b093-c124f70f91f3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.176397] env[63014]: INFO networking_nsxv3.common.synchronization [None req-8580b628-2dfa-423c-9491-ca421951a4b9 tempest-ServersTestJSON-516703967 tempest-ServersTestJSON-516703967-project-member] Enqueued Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_rules [ 895.176397] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_rules [ 895.176624] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.180103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.225658] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d723f12-631f-46b9-8c4e-f48e6a5cbce6 [ 895.226056] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.226415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.226621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.226903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.227096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.227337] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d723f12-631f-46b9-8c4e-f48e6a5cbce6 already deleted. [ 895.227523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d723f12-631f-46b9-8c4e-f48e6a5cbce6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.408873] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.409509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.409869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.410362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.410852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.411186] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb already deleted. [ 895.414899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.414899] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.414899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.414899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.415224] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.918970] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.919249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.919249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.919680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.919680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.919680] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be created. [ 895.943688] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.944030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.944142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.944393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.944512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.944638] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb already deleted. [ 895.944744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.949452] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.949452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.949452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.949655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.949744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.959418] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: UNINITIALIZED for 2s [ 896.071920] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 in Status: SUCCESS [ 896.072110] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 deletion is rescheduled due to dependency. [ 896.072221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.143070] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 896.143445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.143721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.144078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.144437] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.146042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.146042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.146042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.146042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.146042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.146042] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.146772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.147053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.147392] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.147671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.147841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.148086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.148303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.148557] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.652589] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.653516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.655382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.708303] env[63014]: INFO networking_nsxv3.common.synchronization [req-afb92993-90bf-427b-86cf-0acaf66a3e2c req-82791099-62c7-46ed-8ef5-92ade3eb5135 tempest-VolumesAdminNegativeTest-1905375078 tempest-VolumesAdminNegativeTest-1905375078-project-member] Enqueued Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_members [ 896.710266] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 with Priority: HIGHEST for action security_group_members [ 896.710266] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.710266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.710266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.710266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.710266] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.710266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.710266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.710266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.710266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.710695] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a7dcf68e-77c7-4c96-8393-9ad6248f6c31',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.160025] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.212293] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.212571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.212571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.212813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.250835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.251169] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.251305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.251369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.251576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.251654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.251743] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 is going to be updated. [ 897.282190] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.282190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.282190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.282190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.282190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.292945] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 in Status: IN_PROGRESS for 2s [ 897.661720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.662204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.662605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.663052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.663679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.663679] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 897.695686] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.696051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.696186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.696451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.697364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.708094] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 897.970392] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 897.971031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.971031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.971173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.971382] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.971510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.971608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.971784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.972205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.972205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.972205] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.476560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.476560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.476560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.476560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.477261] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.477261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.477261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.477503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.477702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.477902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.478265] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.478416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.478581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.478845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.479131] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.479341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.479465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.479739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.479909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.480088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.480291] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.540126] env[63014]: INFO networking_nsxv3.common.synchronization [None req-4884806c-07af-4d42-9005-ca343ce29521 None None] Enqueued Resource ID: 534f61e6-c698-4416-941c-70efe988bb37 with Priority: HIGHEST for action port [ 898.540685] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 534f61e6-c698-4416-941c-70efe988bb37 with Priority: HIGHEST for action port [ 898.541442] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-534f61e6-c698-4416-941c-70efe988bb37 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.546027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-534f61e6-c698-4416-941c-70efe988bb37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.546027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-534f61e6-c698-4416-941c-70efe988bb37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.546027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-534f61e6-c698-4416-941c-70efe988bb37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.546027] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('534f61e6-c698-4416-941c-70efe988bb37',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.976983] env[63014]: INFO networking_nsxv3.common.synchronization [req-80c1c654-5b5b-4985-8f75-b0adb2f76edb req-06d7b84a-85c6-4bda-ab66-f22b87a14596 tempest-ImagesOneServerNegativeTestJSON-1556540069 tempest-ImagesOneServerNegativeTestJSON-1556540069-project-member] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 898.977542] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 898.977871] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.977996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.978071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.978493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.978493] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.978493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.978626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.978688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.978774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.978879] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.984568] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b917177-fad2-4a8d-bb56-2b4d47acad21: rpc.has_security_group_logging(os_id): False [ 899.007390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.007717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.007827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.008127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.008230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.008532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.008674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.008809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.009297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.009297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.009428] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.009533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.009617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.010124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.010124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.012790] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.012790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.013130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.013188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.013339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.013471] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be created. [ 899.049277] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 534f61e6-c698-4416-941c-70efe988bb37 [ 899.050472] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.050472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.050472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.050746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.051422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.051422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:534f61e6-c698-4416-941c-70efe988bb37 already deleted. [ 899.051422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-534f61e6-c698-4416-941c-70efe988bb37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.083754] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.083963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.084068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.084390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.084984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.099112] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 899.309562] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 in Status: SUCCESS [ 899.309562] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a7dcf68e-77c7-4c96-8393-9ad6248f6c31 deletion is rescheduled due to dependency. [ 899.309562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a7dcf68e-77c7-4c96-8393-9ad6248f6c31" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.483415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.483415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.483415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.483415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.483415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.483415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.483415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.483415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.483987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.483987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.483987] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 899.512021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.512021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.512021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.512021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.512021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.526411] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 899.676853] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.677069] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.677204] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.677476] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.677730] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.677892] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.683079] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.683394] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.683891] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.683891] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.683891] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.684147] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.684147] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.684307] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 899.684357] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.684477] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.713322] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.713322] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 899.713322] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.713322] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-516" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.713322] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.713585] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.713585] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.713914] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.714074] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed9795b-d44b-4ed3-aff0-c6b2d24b0584',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.718124] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 899.718342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.718826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.719051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.719264] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.719707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.719707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.719707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.719846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.719878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.720174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.720783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.720783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.720783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.720783] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.720975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.720975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.721147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.721214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.721402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.721586] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.220387] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.220387] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.220387] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.221573] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.221573] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.222455] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 8ed9795b-d44b-4ed3-aff0-c6b2d24b0584 not found, creating... [ 900.223389] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.223500] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.223582] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.223878] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.227294] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.227688] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.227918] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.228060] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.228362] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.228569] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.228729] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 8ed9795b-d44b-4ed3-aff0-c6b2d24b0584 is going to be created. [ 900.230649] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e50835d8-af5a-48b2-b8ae-a4f696900f48: rpc.has_security_group_logging(os_id): False [ 900.249883] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.249883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.249883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.249883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.249883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.250214] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.250214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.250293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.250429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.250501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.250684] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.250772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.250852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.250996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.251082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.251458] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.251575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.251645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.251803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.251907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.252008] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be created. [ 900.255214] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.255394] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.255517] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.257085] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.257085] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.257085] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.306776] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.306929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.307011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.307253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.307440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.322046] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 900.673617] env[63014]: INFO networking_nsxv3.common.synchronization [req-35b3fc1c-dd59-464b-afe5-8eea36a6c585 req-e52adb63-8a36-4cd3-8e75-484b901ba6e2 tempest-InstanceActionsV221TestJSON-2038071880 tempest-InstanceActionsV221TestJSON-2038071880-project-member] Enqueued Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGHEST for action security_group_members [ 900.673617] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGHEST for action security_group_members [ 900.674032] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.674032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.674032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.675846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.675846] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.675846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.675846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.675846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.675846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.675846] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.808756] env[63014]: INFO networking_nsxv3.common.synchronization [req-e628757d-d44f-4b1d-b4a0-ae918518c119 req-592922a1-c0f8-4c92-b0dc-44cb2e536920 tempest-ServerRescueTestJSON-1023946604 tempest-ServerRescueTestJSON-1023946604-project-member] Enqueued Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 900.811509] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 with Priority: HIGHEST for action security_group_members [ 900.811509] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.811509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.811509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.811509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.811509] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.811509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.811509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.811509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.811509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.811509] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.057618] env[63014]: INFO networking_nsxv3.common.synchronization [None req-0092a02e-ba7a-4f29-930e-afef5075a481 None None] Enqueued Resource ID: cc201b7f-aef7-47cd-b48c-f42defded23c with Priority: HIGHEST for action port [ 901.058028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc201b7f-aef7-47cd-b48c-f42defded23c with Priority: HIGHEST for action port [ 901.058694] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc201b7f-aef7-47cd-b48c-f42defded23c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.058694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc201b7f-aef7-47cd-b48c-f42defded23c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.058797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc201b7f-aef7-47cd-b48c-f42defded23c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.058961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc201b7f-aef7-47cd-b48c-f42defded23c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.059187] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc201b7f-aef7-47cd-b48c-f42defded23c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.111323] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 901.111568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.180921] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.181103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.181167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.181389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.181596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.181676] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.181782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.181842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.181996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.182090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.182181] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 is going to be updated. [ 901.209075] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.209257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.209308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.209527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.209676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.217866] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 in Status: IN_PROGRESS for 2s [ 901.314182] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.314406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.314791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.314791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.314916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.315212] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.315471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.315471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.315583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.315740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.315865] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 is going to be updated. [ 901.331579] env[63014]: INFO networking_nsxv3.common.synchronization [req-80c1c654-5b5b-4985-8f75-b0adb2f76edb req-e8084b6b-7055-4c5e-9894-ef44a62e8994 service nova] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_rules [ 901.331789] env[63014]: INFO networking_nsxv3.common.synchronization [req-80c1c654-5b5b-4985-8f75-b0adb2f76edb req-e8084b6b-7055-4c5e-9894-ef44a62e8994 service nova] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 901.331975] env[63014]: INFO networking_nsxv3.common.synchronization [req-80c1c654-5b5b-4985-8f75-b0adb2f76edb req-e8084b6b-7055-4c5e-9894-ef44a62e8994 service nova] Enqueued Resource ID: 8ed9795b-d44b-4ed3-aff0-c6b2d24b0584 with Priority: HIGHEST for action port [ 901.338456] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_rules [ 901.338456] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 901.338456] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ed9795b-d44b-4ed3-aff0-c6b2d24b0584 with Priority: HIGHEST for action port [ 901.339067] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.339303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.339361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.343050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.343050] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.343050] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.343050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.343050] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.343050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.343919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.343919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.343919] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ed9795b-d44b-4ed3-aff0-c6b2d24b0584',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.350174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.350174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.350174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.350433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.350433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.359396] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: IN_PROGRESS for 2s [ 901.538934] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 901.538934] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 deletion is rescheduled due to dependency. [ 901.538934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.538934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.538934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.538934] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.538934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.538934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.538934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.538934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.538934] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.561487] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc201b7f-aef7-47cd-b48c-f42defded23c [ 901.561817] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.561926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.561963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.562195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.562289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.562388] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc201b7f-aef7-47cd-b48c-f42defded23c already deleted. [ 901.562487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc201b7f-aef7-47cd-b48c-f42defded23c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.590864] env[63014]: INFO networking_nsxv3.common.synchronization [None req-9bad0456-19d4-4c4b-b031-78356d9bff78 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_rules [ 901.592221] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_rules [ 901.592221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.592221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.592467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.592523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.592579] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.707017] env[63014]: INFO networking_nsxv3.common.synchronization [None req-66baf919-9e22-464e-adfd-94fe864a9049 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_rules [ 901.707017] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_rules [ 901.707017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.707017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.848551] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.849458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.849955] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ed9795b-d44b-4ed3-aff0-c6b2d24b0584 with status ACTIVE [ 901.850179] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.850368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.850471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.850744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.850878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.851238] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.851411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.851518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.851721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.851841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.852092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.852238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.852332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.852512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.852626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.852756] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ed9795b-d44b-4ed3-aff0-c6b2d24b0584 is going to be updated. [ 901.874563] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.874738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.874839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.875162] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.875306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.876898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ed9795b-d44b-4ed3-aff0-c6b2d24b0584" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.040681] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.112964] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.112964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.112964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.113118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.113165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.113252] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb already deleted. [ 902.113297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.113442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.113637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.113685] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.338174] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 902.338174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.338174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.338174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.338174] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.542853] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.642973] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.642973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.642973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.642973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.642973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.642973] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb already deleted. [ 902.642973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.841400] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.841763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.841763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.842488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.842488] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.842488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.842488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.842488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.842488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.842488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.842884] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.045409] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.045596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.045655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.045907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.046052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.046192] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 903.079091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.079091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.079091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.079091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.079091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.087798] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 903.236580] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 in Status: SUCCESS [ 903.236807] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 deletion is rescheduled due to dependency. [ 903.236957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.349124] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.349293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.349374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.349690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.349801] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.349904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.350110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.350266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.350364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.350457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.350614] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.350709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.350768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.350930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.351086] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.351193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.351256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.351405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.351486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.351569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.351660] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.369694] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 in Status: SUCCESS [ 903.369694] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4 deletion is rescheduled due to dependency. [ 903.369694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.856966] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e50835d8-af5a-48b2-b8ae-a4f696900f48: rpc.has_security_group_logging(os_id): False [ 903.875727] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.875727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.875727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.875727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.875727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.875727] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.875727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.875727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.876200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.876200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.876200] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.876297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.876297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.876415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.876501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.876686] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.876774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.876830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.876970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.877567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.877777] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 903.933243] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.934127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.934622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.935436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.935629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.947345] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 904.100738] env[63014]: INFO networking_nsxv3.common.synchronization [req-5088c951-d509-48d8-b494-102167ff44c9 req-192339d8-cb7a-47d5-81b2-78bcf0e931f5 tempest-MultipleCreateTestJSON-401204873 tempest-MultipleCreateTestJSON-401204873-project-member] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 904.101357] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 904.101842] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.103587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.103587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.103717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.103930] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.104085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.104152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.105242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.105359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.105612] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.609388] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.628256] env[63014]: INFO networking_nsxv3.common.synchronization [req-40bc857c-c8fd-485c-95fe-0d9ec169386a req-3cf69e67-c330-444e-9b46-a639c33b727a tempest-MultipleCreateTestJSON-401204873 tempest-MultipleCreateTestJSON-401204873-project-member] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 904.628764] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGHEST for action security_group_members [ 904.629615] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.629615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.060987] env[63014]: INFO networking_nsxv3.common.synchronization [None req-97e9869e-1181-4e56-b122-a22f26413daf None None] Enqueued Resource ID: 31869d68-18d2-42fa-b97b-dc1833c22730 with Priority: HIGHEST for action port [ 905.061381] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31869d68-18d2-42fa-b97b-dc1833c22730 with Priority: HIGHEST for action port [ 905.062140] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-31869d68-18d2-42fa-b97b-dc1833c22730 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.062140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31869d68-18d2-42fa-b97b-dc1833c22730" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.062140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31869d68-18d2-42fa-b97b-dc1833c22730" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.064183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31869d68-18d2-42fa-b97b-dc1833c22730" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.064183] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31869d68-18d2-42fa-b97b-dc1833c22730',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.100282] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 905.100857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.102762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.102762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.102762] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.102762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.102762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.102762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.103368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.103368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.103368] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.116797] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.566243] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31869d68-18d2-42fa-b97b-dc1833c22730 [ 905.566847] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.566847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.566980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.567232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.567350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.567474] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31869d68-18d2-42fa-b97b-dc1833c22730 already deleted. [ 905.567577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31869d68-18d2-42fa-b97b-dc1833c22730" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.606496] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.606664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.606742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.606972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.607164] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.607270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.607335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.607484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.607577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.607658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.607804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.607898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.607958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.608116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.608253] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.608341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.608400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.608531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.608606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.608685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.608775] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.618274] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.618437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.618504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.618701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.618802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.618871] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 905.646883] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.647198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.647198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.647368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.647441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.655794] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 905.962219] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 905.962219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.115171] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08: rpc.has_security_group_logging(os_id): False [ 906.133990] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.134178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.134245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.134476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.134572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.134767] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.134985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.135111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.135211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.135292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.135491] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.135586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.135648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.135789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.135868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.136146] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.136244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.136423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.136475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.136511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.136630] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 906.198420] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.198420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.198420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.198420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.198420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.212112] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 907.498574] env[63014]: INFO networking_nsxv3.common.synchronization [None req-b41b1380-8ef2-4a52-8a49-a3970f5fa4f0 None None] Enqueued Resource ID: 5964c31e-4931-41dd-a319-a576f4abb354 with Priority: HIGHEST for action port [ 907.498832] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5964c31e-4931-41dd-a319-a576f4abb354 with Priority: HIGHEST for action port [ 907.499440] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-5964c31e-4931-41dd-a319-a576f4abb354 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.499759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5964c31e-4931-41dd-a319-a576f4abb354" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.499759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5964c31e-4931-41dd-a319-a576f4abb354" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.499872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5964c31e-4931-41dd-a319-a576f4abb354" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.500500] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5964c31e-4931-41dd-a319-a576f4abb354',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.665844] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 907.665844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.666844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.666844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.666844] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.666844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.666844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.666844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.667202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.667310] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.007402] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5964c31e-4931-41dd-a319-a576f4abb354 [ 908.007766] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.007868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.007926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.008198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.008318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.008423] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5964c31e-4931-41dd-a319-a576f4abb354 already deleted. [ 908.008520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5964c31e-4931-41dd-a319-a576f4abb354" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.171813] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.171813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.171813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.171951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.172044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.172258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.172362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.172416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.172573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.172663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.172748] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be updated. [ 908.197211] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.197310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.197360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.197577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.197719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.209728] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: IN_PROGRESS for 2s [ 908.224776] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 908.225054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.219647] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 in Status: SUCCESS [ 910.220055] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 deletion is rescheduled due to dependency. [ 910.220055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.499815] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 912.500223] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 913.617805] env[63014]: INFO networking_nsxv3.common.synchronization [req-2638f655-7df7-477d-b09b-e5cee6bf98ce req-9295c35e-3a39-4d96-a672-c3ed81c5bd0a tempest-ImagesOneServerNegativeTestJSON-1556540069 tempest-ImagesOneServerNegativeTestJSON-1556540069-project-member] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 913.618386] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGHEST for action security_group_members [ 913.618692] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.618824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.618876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.619119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.619280] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.619375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.619437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.619587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.619680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.619912] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.124958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.124958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.124958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.124958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.124958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.124958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.124958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.124958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.124958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.124958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.124958] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be updated. [ 914.153649] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.153649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.153649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.153907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.153907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.163106] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: IN_PROGRESS for 2s [ 914.297160] env[63014]: INFO networking_nsxv3.common.synchronization [req-c3db46a5-c95b-48dc-b09a-0c79dddc4dd8 req-814fc2d6-69ae-4572-9307-a159cfc50bfe tempest-MigrationsAdminTest-518512597 tempest-MigrationsAdminTest-518512597-project-member] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 914.297160] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 914.297442] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.297564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.297687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.297896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.298570] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.298570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.298570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.298570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.298570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.298570] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.804440] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.307203] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.651134] env[63014]: INFO networking_nsxv3.common.synchronization [req-4a2f9595-5b39-4708-9a55-682716233fdc req-980342ed-3173-482a-b4b2-c53a18fb37cb tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 915.652603] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 915.653085] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.653374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.653559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.653851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.655709] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.655709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.655709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.655709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.655709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.655709] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.813999] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.814364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.814364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.814446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.814527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.814618] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be updated. [ 915.840957] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.841166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.841208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.841400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.841585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.851026] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: IN_PROGRESS for 2s [ 916.158024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.158024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.158024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.158024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.158024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.158350] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.158350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.158350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.158467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.158467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.158544] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 916.172169] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 in Status: SUCCESS [ 916.172647] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 deletion is rescheduled due to dependency. [ 916.172976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.190712] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.190712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.190712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.190712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.190712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.200369] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 916.579543] env[63014]: INFO networking_nsxv3.common.synchronization [None req-b981decb-66cd-4255-900b-ba3f7c40c75c None None] Enqueued Resource ID: afb3695f-14fc-46e3-ace3-fabe56d8ded3 with Priority: HIGHEST for action port [ 916.580851] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afb3695f-14fc-46e3-ace3-fabe56d8ded3 with Priority: HIGHEST for action port [ 916.583514] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-afb3695f-14fc-46e3-ace3-fabe56d8ded3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.583735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afb3695f-14fc-46e3-ace3-fabe56d8ded3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.583811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afb3695f-14fc-46e3-ace3-fabe56d8ded3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.584099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afb3695f-14fc-46e3-ace3-fabe56d8ded3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.584184] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afb3695f-14fc-46e3-ace3-fabe56d8ded3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.065175] env[63014]: INFO networking_nsxv3.common.synchronization [req-a1e3e4ae-a2a2-4991-b887-75c3a7f6239b req-d9c6c26e-f8a7-4573-9d21-716a286baf89 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 917.068201] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 917.068311] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.068386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.068452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.068638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.068794] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.068891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.068943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.069114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.069211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.069314] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.088169] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afb3695f-14fc-46e3-ace3-fabe56d8ded3 [ 917.088706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.088706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.088706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.088879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.088879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.088946] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afb3695f-14fc-46e3-ace3-fabe56d8ded3 already deleted. [ 917.088980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afb3695f-14fc-46e3-ace3-fabe56d8ded3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.421117] env[63014]: INFO networking_nsxv3.common.synchronization [None req-e58adf54-7c07-483b-b5f6-3527afe49e73 tempest-ServerActionsTestOtherB-7425835 tempest-ServerActionsTestOtherB-7425835-project-member] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 917.421117] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 917.421117] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.421117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.421117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.422126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.422322] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.525303] env[63014]: INFO networking_nsxv3.common.synchronization [None req-e1abe250-15be-4fab-b3a4-e16b3e03d1d2 tempest-ServerActionsTestOtherB-7425835 tempest-ServerActionsTestOtherB-7425835-project-member] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 917.527066] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 917.527066] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.527066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.571435] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.571435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.571435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.571932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.571932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.571932] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.571932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.572145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.572145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.572209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.572293] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 917.634498] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.634647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.634704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.634959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.635256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.646929] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 917.860980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: SUCCESS [ 917.861740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.944556] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.944556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.944556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.944556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.944556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.944556] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db110989-027c-4ed8-b5db-6b256912c344 already deleted. [ 917.944556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.944556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.944556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.944556] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.211020] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 918.211435] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 deletion is rescheduled due to dependency. [ 918.211435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.467551] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.467551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.467551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.467551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.467551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.467551] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db110989-027c-4ed8-b5db-6b256912c344 already deleted. [ 918.467551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.824918] env[63014]: INFO networking_nsxv3.common.synchronization [None req-f50f350a-b907-46f9-beb5-4465db8b7bfe None None] Enqueued Resource ID: d8408a2f-c695-4e02-bec8-a9b9e024fdc3 with Priority: HIGHEST for action port [ 918.825225] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8408a2f-c695-4e02-bec8-a9b9e024fdc3 with Priority: HIGHEST for action port [ 918.825771] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8408a2f-c695-4e02-bec8-a9b9e024fdc3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.825895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8408a2f-c695-4e02-bec8-a9b9e024fdc3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.825956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8408a2f-c695-4e02-bec8-a9b9e024fdc3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.826217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8408a2f-c695-4e02-bec8-a9b9e024fdc3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.826300] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8408a2f-c695-4e02-bec8-a9b9e024fdc3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.330242] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8408a2f-c695-4e02-bec8-a9b9e024fdc3 [ 919.330500] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.330611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.330680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.330894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.330986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.331118] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8408a2f-c695-4e02-bec8-a9b9e024fdc3 already deleted. [ 919.331312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8408a2f-c695-4e02-bec8-a9b9e024fdc3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.658571] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 919.658733] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 919.658857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.431835] env[63014]: INFO networking_nsxv3.common.synchronization [req-bdbbfc8f-e915-4da9-8098-5b913510c0ba req-07daea86-6279-48d1-9ba2-acf4ca0307fd tempest-AttachVolumeTestJSON-1387786992 tempest-AttachVolumeTestJSON-1387786992-project-member] Enqueued Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_members [ 921.432119] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_members [ 921.432274] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a039f0-af50-4be6-96e7-c2a3698d5144 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.432402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.432457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.432706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.432868] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.432972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.433046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.433206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.433292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.433385] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.748103] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-487 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.748533] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-487" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.748533] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-487" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.748708] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-487" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.748968] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.749144] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.749555] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.749555] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.749779] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.749889] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 921.750931] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.750931] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.750931] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.750931] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 921.750931] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.750931] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.774543] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.774665] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 921.774814] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.775063] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-487" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.775391] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-c08e787a-d10c-4b53-88d7-d410e2f4c99f taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.775567] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-c08e787a-d10c-4b53-88d7-d410e2f4c99f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.775693] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-c08e787a-d10c-4b53-88d7-d410e2f4c99f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.776034] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-c08e787a-d10c-4b53-88d7-d410e2f4c99f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.776215] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c08e787a-d10c-4b53-88d7-d410e2f4c99f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.936540] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.936671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.936745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.937010] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.937138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.937347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.937450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.937511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.937847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.937847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.937847] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 already deleted. [ 921.937940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.279546] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.279784] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.279906] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.280234] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.280404] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.280669] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port c08e787a-d10c-4b53-88d7-d410e2f4c99f not found, creating... [ 922.280974] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.281184] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.281308] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.281605] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.281791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.282096] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.282269] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.282394] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.282619] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.282760] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.282947] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: c08e787a-d10c-4b53-88d7-d410e2f4c99f is going to be created. [ 922.301463] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.301683] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.301813] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.302124] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.302416] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.302672] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-c08e787a-d10c-4b53-88d7-d410e2f4c99f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.026855] env[63014]: INFO networking_nsxv3.common.synchronization [req-bdbbfc8f-e915-4da9-8098-5b913510c0ba req-255dd2e0-3ee8-459b-8101-edbd2449fb60 service nova] Enqueued Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_rules [ 923.027110] env[63014]: INFO networking_nsxv3.common.synchronization [req-bdbbfc8f-e915-4da9-8098-5b913510c0ba req-255dd2e0-3ee8-459b-8101-edbd2449fb60 service nova] Enqueued Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_members [ 923.027271] env[63014]: INFO networking_nsxv3.common.synchronization [req-bdbbfc8f-e915-4da9-8098-5b913510c0ba req-255dd2e0-3ee8-459b-8101-edbd2449fb60 service nova] Enqueued Resource ID: c08e787a-d10c-4b53-88d7-d410e2f4c99f with Priority: HIGHEST for action port [ 923.027886] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_rules [ 923.027971] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_members [ 923.028257] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c08e787a-d10c-4b53-88d7-d410e2f4c99f with Priority: HIGHEST for action port [ 923.028619] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89a039f0-af50-4be6-96e7-c2a3698d5144 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.028780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.028949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.029191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.029289] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.030795] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a039f0-af50-4be6-96e7-c2a3698d5144 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.031017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.031102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.031599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.032073] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.032073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.032073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.032280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.032382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.032477] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.033666] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-c08e787a-d10c-4b53-88d7-d410e2f4c99f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.035971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c08e787a-d10c-4b53-88d7-d410e2f4c99f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.035971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c08e787a-d10c-4b53-88d7-d410e2f4c99f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.035971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c08e787a-d10c-4b53-88d7-d410e2f4c99f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.035971] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c08e787a-d10c-4b53-88d7-d410e2f4c99f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.531889] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a039f0-af50-4be6-96e7-c2a3698d5144 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.532016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.535546] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.535890] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c08e787a-d10c-4b53-88d7-d410e2f4c99f with status ACTIVE [ 923.536130] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.536257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.536324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.536553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.536645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.536851] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.536952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.537025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.537182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.537348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.537465] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.537586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.537641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.539032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.539032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.539032] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c08e787a-d10c-4b53-88d7-d410e2f4c99f is going to be updated. [ 923.557992] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.558218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.558322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.559066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.559066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.559066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c08e787a-d10c-4b53-88d7-d410e2f4c99f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.982254] env[63014]: INFO networking_nsxv3.common.synchronization [None req-dec0d4ce-26b0-40fd-9715-ccabe0725635 tempest-AttachVolumeShelveTestJSON-960433482 tempest-AttachVolumeShelveTestJSON-960433482-project-member] Enqueued Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_rules [ 923.982254] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_rules [ 923.984221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.984359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.984416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.984742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.984742] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.040337] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.093143] env[63014]: INFO networking_nsxv3.common.synchronization [None req-c3fb09b0-4b06-4389-8139-80379eeaa1c2 tempest-AttachVolumeShelveTestJSON-960433482 tempest-AttachVolumeShelveTestJSON-960433482-project-member] Enqueued Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_rules [ 924.093682] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_rules [ 924.093987] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.094109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.505223] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.505223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.505223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.505223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.505399] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.505429] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 already deleted. [ 924.505524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.505641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.505928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.506050] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.543034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.543034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.543034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.543034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.543293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.543293] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 is going to be created. [ 924.564865] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.564865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.565128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.565165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.565439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.574718] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 in Status: UNINITIALIZED for 2s [ 925.025105] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.025308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.025362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.025591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.025688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.025808] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 already deleted. [ 925.025900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.587664] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 in Status: SUCCESS [ 926.587946] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.588600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.588600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.588746] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.588813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.588995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.589144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.589260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.589372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.589494] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.092370] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.594274] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89a039f0-af50-4be6-96e7-c2a3698d5144: rpc.has_security_group_logging(os_id): False [ 927.618749] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.618971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.619028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.619241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.619345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.619597] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.619698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.619757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.619914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.619994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.620095] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 is going to be created. [ 927.686107] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.686306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.686407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.686732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.687042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.699991] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 in Status: IN_PROGRESS for 2s [ 929.094381] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 929.094704] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 929.137136] env[63014]: INFO networking_nsxv3.common.synchronization [req-fc5b277c-5a28-4306-9ed9-fe75e922ea66 req-392f100f-8a45-4fcf-b7dd-d0ec80f3dfbf tempest-ServersTestJSON-516703967 tempest-ServersTestJSON-516703967-project-member] Enqueued Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_members [ 929.137136] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_members [ 929.137136] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.137136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.137136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.137360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.137360] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.137466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.137522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.137679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.137759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.137850] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.642642] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.642642] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.642642] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb already deleted. [ 929.642642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.714326] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 in Status: SUCCESS [ 929.714326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.740472] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-797 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.740691] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-797" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.740891] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-797" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.741192] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-797" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.741521] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.741722] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.741826] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.742574] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.742574] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.742574] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.743103] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.743103] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.743103] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.743355] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.743521] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.743713] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.762731] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.763050] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 929.763229] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.763445] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-797" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.763891] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-7752e599-918d-466e-bcc8-9b0661204d98 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.764408] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-7752e599-918d-466e-bcc8-9b0661204d98" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.764576] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-7752e599-918d-466e-bcc8-9b0661204d98" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.764933] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-7752e599-918d-466e-bcc8-9b0661204d98" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.765358] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7752e599-918d-466e-bcc8-9b0661204d98',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.268967] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.269700] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.269700] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.269818] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.269982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.270209] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 7752e599-918d-466e-bcc8-9b0661204d98 not found, creating... [ 930.270539] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.270745] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.270907] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.271335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.271543] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.272056] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.272442] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.272703] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.273163] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.273381] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.273757] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 7752e599-918d-466e-bcc8-9b0661204d98 is going to be created. [ 930.292343] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.292636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.292784] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.293139] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.293381] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.293626] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-7752e599-918d-466e-bcc8-9b0661204d98" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.365411] env[63014]: INFO networking_nsxv3.common.synchronization [req-fc5b277c-5a28-4306-9ed9-fe75e922ea66 req-572bd228-2892-47f0-b1e6-6a1583dd821c service nova] Enqueued Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_rules [ 931.365810] env[63014]: INFO networking_nsxv3.common.synchronization [req-fc5b277c-5a28-4306-9ed9-fe75e922ea66 req-572bd228-2892-47f0-b1e6-6a1583dd821c service nova] Enqueued Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_members [ 931.365810] env[63014]: INFO networking_nsxv3.common.synchronization [req-fc5b277c-5a28-4306-9ed9-fe75e922ea66 req-572bd228-2892-47f0-b1e6-6a1583dd821c service nova] Enqueued Resource ID: 7752e599-918d-466e-bcc8-9b0661204d98 with Priority: HIGHEST for action port [ 931.366305] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_rules [ 931.366429] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_members [ 931.366527] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7752e599-918d-466e-bcc8-9b0661204d98 with Priority: HIGHEST for action port [ 931.370021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.370021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.370021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.370021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.370021] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.370021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.370021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.370021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.370021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.370663] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.370663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.371049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.371242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.371659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.371761] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.372811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-7752e599-918d-466e-bcc8-9b0661204d98 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.372941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7752e599-918d-466e-bcc8-9b0661204d98" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.373142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7752e599-918d-466e-bcc8-9b0661204d98" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.374483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7752e599-918d-466e-bcc8-9b0661204d98" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.374483] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7752e599-918d-466e-bcc8-9b0661204d98',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.876556] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.878059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.878216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.878462] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7752e599-918d-466e-bcc8-9b0661204d98 with status ACTIVE [ 931.878721] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.878894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.879016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.879338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.879489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.880880] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.881076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.881199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.881488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.881631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.881935] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.882111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.882225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.882481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.882624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.882768] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7752e599-918d-466e-bcc8-9b0661204d98 is going to be updated. [ 931.908209] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.908388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.909179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.909179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.909179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.909179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7752e599-918d-466e-bcc8-9b0661204d98" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.386274] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.891262] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.892036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.892898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.892898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.894128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.894128] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb is going to be created. [ 932.917878] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.919370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.919491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.923163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.923163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.923163] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d0e09178-1146-456c-8be9-e70af409b995 None None] Enqueued Resource ID: 8d40d3ca-516c-4622-a939-2ffdd68fba34 with Priority: HIGHEST for action port [ 932.923163] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d40d3ca-516c-4622-a939-2ffdd68fba34 with Priority: HIGHEST for action port [ 932.925566] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d40d3ca-516c-4622-a939-2ffdd68fba34 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.925848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d40d3ca-516c-4622-a939-2ffdd68fba34" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.925968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d40d3ca-516c-4622-a939-2ffdd68fba34" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.926284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d40d3ca-516c-4622-a939-2ffdd68fba34" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.926552] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d40d3ca-516c-4622-a939-2ffdd68fba34',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.933212] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb in Status: UNINITIALIZED for 2s [ 933.429042] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d40d3ca-516c-4622-a939-2ffdd68fba34 [ 933.429330] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.429420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.429485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.429731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.429821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.429915] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d40d3ca-516c-4622-a939-2ffdd68fba34 already deleted. [ 933.430037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d40d3ca-516c-4622-a939-2ffdd68fba34" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.947439] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb in Status: SUCCESS [ 934.947718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.947718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.948546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.948546] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.948546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.948546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.948546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.948546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.949019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.949019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.135751] env[63014]: INFO networking_nsxv3.common.synchronization [None req-9dfeac77-c976-4006-8876-7af26fe887dc None None] Enqueued Resource ID: 236e4ac5-5eeb-4101-b3c3-77b4d8d2722b with Priority: HIGHEST for action port [ 935.136387] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 236e4ac5-5eeb-4101-b3c3-77b4d8d2722b with Priority: HIGHEST for action port [ 935.136703] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-236e4ac5-5eeb-4101-b3c3-77b4d8d2722b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.136827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-236e4ac5-5eeb-4101-b3c3-77b4d8d2722b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.136887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-236e4ac5-5eeb-4101-b3c3-77b4d8d2722b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.137157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-236e4ac5-5eeb-4101-b3c3-77b4d8d2722b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.137246] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('236e4ac5-5eeb-4101-b3c3-77b4d8d2722b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.452880] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.639417] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 236e4ac5-5eeb-4101-b3c3-77b4d8d2722b [ 935.639821] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.640015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.640140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.640420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.640523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.640650] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:236e4ac5-5eeb-4101-b3c3-77b4d8d2722b already deleted. [ 935.640778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-236e4ac5-5eeb-4101-b3c3-77b4d8d2722b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.959083] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b5e3c0e-e904-4e19-9ad4-9885064b94bb: rpc.has_security_group_logging(os_id): False [ 936.000236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.000389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.000481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.000772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.000871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.001729] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.001729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.001729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.001729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.001729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.001729] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb is going to be created. [ 936.068458] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.068624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.068693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.068921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.069238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.081617] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb in Status: IN_PROGRESS for 2s [ 936.177206] env[63014]: INFO networking_nsxv3.common.synchronization [req-8342a923-ac30-4395-8524-24cc80ef9466 req-0263803b-ef08-4b20-8584-3b2957447b32 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_members [ 936.177364] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_members [ 936.179608] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.179608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.181145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.181442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.181631] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.181744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.181821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.181991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.182093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.182195] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.688299] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.688299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.688299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.688462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.688462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.689019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.689019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.689019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.689019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.689365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.689365] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb already deleted. [ 936.689365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.709345] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.709657] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.709657] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.709991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.710263] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.710424] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.710545] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.710772] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.710918] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.711302] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.711545] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 936.711676] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 936.711977] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 936.712123] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 936.712402] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 936.712591] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 936.738134] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 936.738320] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 936.738462] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 936.738639] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.738953] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-f42f1235-a014-40a9-ae3e-976616173d18 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.739145] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-f42f1235-a014-40a9-ae3e-976616173d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.739273] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-f42f1235-a014-40a9-ae3e-976616173d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.739718] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-f42f1235-a014-40a9-ae3e-976616173d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.739718] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42f1235-a014-40a9-ae3e-976616173d18',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.244257] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.244570] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.244613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.244905] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.245085] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.245266] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port f42f1235-a014-40a9-ae3e-976616173d18 not found, creating... [ 937.245539] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.245700] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.245820] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.246060] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.246210] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.246486] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.246643] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.246761] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.246971] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.247123] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.247271] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: f42f1235-a014-40a9-ae3e-976616173d18 is going to be created. [ 937.266676] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.267477] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.267477] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.267477] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.267733] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.267830] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-f42f1235-a014-40a9-ae3e-976616173d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.092765] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb in Status: SUCCESS [ 938.093061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.330196] env[63014]: INFO networking_nsxv3.common.synchronization [req-8342a923-ac30-4395-8524-24cc80ef9466 req-cedc5d70-cc91-46c7-bd03-5f7371576ff7 service nova] Enqueued Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_rules [ 938.330662] env[63014]: INFO networking_nsxv3.common.synchronization [req-8342a923-ac30-4395-8524-24cc80ef9466 req-cedc5d70-cc91-46c7-bd03-5f7371576ff7 service nova] Enqueued Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_members [ 938.330662] env[63014]: INFO networking_nsxv3.common.synchronization [req-8342a923-ac30-4395-8524-24cc80ef9466 req-cedc5d70-cc91-46c7-bd03-5f7371576ff7 service nova] Enqueued Resource ID: f42f1235-a014-40a9-ae3e-976616173d18 with Priority: HIGHEST for action port [ 938.331591] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_rules [ 938.331591] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_members [ 938.331591] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f42f1235-a014-40a9-ae3e-976616173d18 with Priority: HIGHEST for action port [ 938.331591] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.331734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.331734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.332133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.332133] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.334128] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.334238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.337310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.337310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.337310] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.337310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.337310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.337310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.337310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.337310] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.337310] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f42f1235-a014-40a9-ae3e-976616173d18 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.337713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f42f1235-a014-40a9-ae3e-976616173d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.337713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f42f1235-a014-40a9-ae3e-976616173d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.337713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f42f1235-a014-40a9-ae3e-976616173d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.337713] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f42f1235-a014-40a9-ae3e-976616173d18',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.839523] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.839675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.839856] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.840780] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f42f1235-a014-40a9-ae3e-976616173d18 with status ACTIVE [ 938.841024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.841118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.841161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.841356] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.841446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.841618] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.841714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.841778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.841923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.842007] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.842193] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.842289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.842350] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.842492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.842567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.842650] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f42f1235-a014-40a9-ae3e-976616173d18 is going to be updated. [ 938.864868] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.864868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.864868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.864868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.864868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.864868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f42f1235-a014-40a9-ae3e-976616173d18" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.347010] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.849868] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.850112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.850245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.850572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.850714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.850824] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb is going to be created. [ 939.873609] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.873726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.873788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.874007] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.874176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.885420] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb in Status: UNINITIALIZED for 2s [ 941.896642] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb in Status: SUCCESS [ 941.897023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.897334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.897559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.897765] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.897889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.897980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.898200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.898374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.898374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.898374] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.402248] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.453021] env[63014]: INFO networking_nsxv3.common.synchronization [req-ddaa7c3a-dc54-4af9-89bb-97c20fca4c37 req-6b242c6f-e0fc-48c4-83e6-ca78e294e3f6 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_members [ 942.453021] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGHEST for action security_group_members [ 942.455632] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.458438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.458438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.458438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.458438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.458438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.458438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.458438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.458438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.458438] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.826800] env[63014]: INFO networking_nsxv3.common.synchronization [req-27195305-7259-4e90-a0d6-07380a530022 req-e28d588f-3700-4714-b368-e37579a6284d tempest-ServerRescueNegativeTestJSON-1204428609 tempest-ServerRescueNegativeTestJSON-1204428609-project-member] Enqueued Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_members [ 942.827429] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGHEST for action security_group_members [ 942.827929] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b799ddde-e254-4e10-850e-ade205a5fd9b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.828097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.828183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.828427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.828602] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.829025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.829101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.829268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.829359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.829474] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.911248] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb: rpc.has_security_group_logging(os_id): False [ 942.930404] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.930404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.930404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.930404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.930404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.930404] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.930404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.930404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.930404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.930404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.930404] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb is going to be created. [ 942.961769] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.961889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.961961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.962282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.962372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.962563] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.962657] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.962801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.962867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.962941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.963034] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e is going to be updated. [ 942.987246] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.987380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.987452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.987661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.987840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.992405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.992405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.992405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.992405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.992405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.999864] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e in Status: IN_PROGRESS for 2s [ 943.003598] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb in Status: IN_PROGRESS for 2s [ 943.331351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.331509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.334080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.334080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.334080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.334080] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.334080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.334080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.334080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.334080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.334080] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b799ddde-e254-4e10-850e-ade205a5fd9b is going to be updated. [ 943.395587] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.395924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.395924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.396132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.396254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.406746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b799ddde-e254-4e10-850e-ade205a5fd9b in Status: IN_PROGRESS for 2s [ 943.833660] env[63014]: INFO networking_nsxv3.common.synchronization [req-99650b13-35f2-4c6e-9dc4-374ae677dff0 req-816fbfac-ca79-4db0-a2ad-bd8583df876f tempest-InstanceActionsTestJSON-572112520 tempest-InstanceActionsTestJSON-572112520-project-member] Enqueued Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGHEST for action security_group_members [ 943.834275] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGHEST for action security_group_members [ 943.835220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-294457ec-0617-4c91-a38e-e6195397f5a3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.835220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.835220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.835220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.835454] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.835454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.835544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.835654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.835738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.835830] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.118656] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-601 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.119023] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-601" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.119023] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-601" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.119328] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-601" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.119594] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.119757] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.119876] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.120129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.120279] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.120487] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.120602] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 944.120712] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 944.120822] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 944.120939] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 944.121057] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 944.121195] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 944.138230] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 944.138394] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 944.138534] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 944.138698] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-601" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.138978] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-42a91455-f275-40a9-91e2-eb4f85222192 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.139154] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-42a91455-f275-40a9-91e2-eb4f85222192" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.139275] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-42a91455-f275-40a9-91e2-eb4f85222192" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.139557] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-42a91455-f275-40a9-91e2-eb4f85222192" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.139694] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a91455-f275-40a9-91e2-eb4f85222192',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.337885] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.338102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.338216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.338359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.338448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.338649] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.338743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.338795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.338943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.339044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.339170] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 294457ec-0617-4c91-a38e-e6195397f5a3 already deleted. [ 944.339238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.642548] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.642773] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.642903] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.643263] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.643423] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.643585] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 42a91455-f275-40a9-91e2-eb4f85222192 not found, creating... [ 944.643847] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.644065] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.644225] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.644451] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.644594] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.644878] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.645081] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.645262] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.645535] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.645704] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.645878] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 42a91455-f275-40a9-91e2-eb4f85222192 is going to be created. [ 944.682774] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.683020] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.683091] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.683363] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.683594] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.684075] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-42a91455-f275-40a9-91e2-eb4f85222192" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.009384] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e in Status: SUCCESS [ 945.009580] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e deletion is rescheduled due to dependency. [ 945.009694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.013415] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb in Status: SUCCESS [ 945.013582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.354275] env[63014]: INFO networking_nsxv3.common.synchronization [req-99650b13-35f2-4c6e-9dc4-374ae677dff0 req-c90cb086-d624-42be-acdb-0f5bb8be20f0 service nova] Enqueued Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGHEST for action security_group_rules [ 945.354275] env[63014]: INFO networking_nsxv3.common.synchronization [req-99650b13-35f2-4c6e-9dc4-374ae677dff0 req-c90cb086-d624-42be-acdb-0f5bb8be20f0 service nova] Enqueued Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGHEST for action security_group_members [ 945.354275] env[63014]: INFO networking_nsxv3.common.synchronization [req-99650b13-35f2-4c6e-9dc4-374ae677dff0 req-c90cb086-d624-42be-acdb-0f5bb8be20f0 service nova] Enqueued Resource ID: 42a91455-f275-40a9-91e2-eb4f85222192 with Priority: HIGHEST for action port [ 945.354275] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGHEST for action security_group_rules [ 945.354771] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGHEST for action security_group_members [ 945.354771] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a91455-f275-40a9-91e2-eb4f85222192 with Priority: HIGHEST for action port [ 945.355941] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-294457ec-0617-4c91-a38e-e6195397f5a3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.355941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.355941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.355941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.355941] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.356618] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-294457ec-0617-4c91-a38e-e6195397f5a3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.356618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.356618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.356780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.357451] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.357451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.357451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.357451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.357451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.357451] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.358764] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-42a91455-f275-40a9-91e2-eb4f85222192 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.358942] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42a91455-f275-40a9-91e2-eb4f85222192" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.359017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42a91455-f275-40a9-91e2-eb4f85222192" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.359285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42a91455-f275-40a9-91e2-eb4f85222192" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.359285] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42a91455-f275-40a9-91e2-eb4f85222192',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.416613] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b799ddde-e254-4e10-850e-ade205a5fd9b in Status: SUCCESS [ 945.416800] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b799ddde-e254-4e10-850e-ade205a5fd9b deletion is rescheduled due to dependency. [ 945.416914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.861402] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-294457ec-0617-4c91-a38e-e6195397f5a3 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.865331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.865541] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.866512] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42a91455-f275-40a9-91e2-eb4f85222192 with status ACTIVE [ 945.866703] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.866815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.866881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.867106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.867197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.867370] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.867463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.867525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.867675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.867752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.867930] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.868324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.868386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.868549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.868630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.868725] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42a91455-f275-40a9-91e2-eb4f85222192 is going to be updated. [ 945.889562] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.889562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.889562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.889562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.890013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.890194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42a91455-f275-40a9-91e2-eb4f85222192" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.371911] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.874920] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.875319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.875319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.875493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.875548] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.875600] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 294457ec-0617-4c91-a38e-e6195397f5a3 is going to be created. [ 946.897845] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.897845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.897845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.897845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.897845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.905601] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 294457ec-0617-4c91-a38e-e6195397f5a3 in Status: UNINITIALIZED for 2s [ 948.916172] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 294457ec-0617-4c91-a38e-e6195397f5a3 in Status: SUCCESS [ 948.916462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.916558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.917169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.917169] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.917169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.917169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.917429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.917470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.917933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.917933] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.421565] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-294457ec-0617-4c91-a38e-e6195397f5a3 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.421773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.421773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.422012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.422190] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.422294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.422358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.422509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.422597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.422686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.422832] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-294457ec-0617-4c91-a38e-e6195397f5a3 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.422922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.423176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.423386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.423788] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.423788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.423788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.423968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.423968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.424043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.424436] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.927943] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 294457ec-0617-4c91-a38e-e6195397f5a3: rpc.has_security_group_logging(os_id): False [ 949.946060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.946218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.946271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.946490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.946582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.946766] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.946853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.946918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.947081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.947158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.947342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.947477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.947545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.947692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.947768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.947961] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.948067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.948125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.948271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.948345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.948425] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 294457ec-0617-4c91-a38e-e6195397f5a3 is going to be created. [ 949.999845] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.000035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.000109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.000285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.000449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.012797] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 294457ec-0617-4c91-a38e-e6195397f5a3 in Status: IN_PROGRESS for 2s [ 950.355643] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 950.355643] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 951.232986] env[63014]: INFO networking_nsxv3.common.synchronization [req-b87b1797-565f-489b-bab5-bde35a8147f5 req-e33e417f-5bf8-425f-a0e0-26737f4ac63f tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 951.232986] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 951.232986] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.232986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.232986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.232986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.232986] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.232986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.232986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.233548] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.233548] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.233548] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.703379] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.703379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.703379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.703379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.703379] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.703379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.703379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.703379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.703379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.703379] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.703379] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.706245] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.706964] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.706964] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 951.706964] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.706964] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.726538] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.726639] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 951.726792] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.726967] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.727338] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.727595] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.727691] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.728013] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.728126] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ce480c-c890-4a63-a3f7-473d0d78d8f2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.737073] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.737426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.737593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.737800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.737984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.738245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.738338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.738416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.738611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.738728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.738843] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 951.761316] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.762201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.762314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.762754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.763102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.771687] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 952.023422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 294457ec-0617-4c91-a38e-e6195397f5a3 in Status: SUCCESS [ 952.023975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.233025] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.233025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.233025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.233025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.233025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.233025] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port a2ce480c-c890-4a63-a3f7-473d0d78d8f2 not found, creating... [ 952.233025] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.233025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.233025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.233025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.233025] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.233776] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.233776] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.233776] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.233776] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.233776] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.233776] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: a2ce480c-c890-4a63-a3f7-473d0d78d8f2 is going to be created. [ 952.256827] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.256827] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.256827] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.256827] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.256827] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.256827] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.957544] env[63014]: INFO networking_nsxv3.common.synchronization [req-b87b1797-565f-489b-bab5-bde35a8147f5 req-a2eb87c1-3b25-459d-bd99-74328192a366 service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 952.959016] env[63014]: INFO networking_nsxv3.common.synchronization [req-b87b1797-565f-489b-bab5-bde35a8147f5 req-a2eb87c1-3b25-459d-bd99-74328192a366 service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 952.959016] env[63014]: INFO networking_nsxv3.common.synchronization [req-b87b1797-565f-489b-bab5-bde35a8147f5 req-a2eb87c1-3b25-459d-bd99-74328192a366 service nova] Enqueued Resource ID: a2ce480c-c890-4a63-a3f7-473d0d78d8f2 with Priority: HIGHEST for action port [ 952.959016] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 952.959774] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 952.963041] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ce480c-c890-4a63-a3f7-473d0d78d8f2 with Priority: HIGHEST for action port [ 952.963041] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.963041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.963041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.963041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.963041] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.963041] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.963041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.963041] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.963041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.963041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.963041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.963041] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2ce480c-c890-4a63-a3f7-473d0d78d8f2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.465051] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2ce480c-c890-4a63-a3f7-473d0d78d8f2 with status ACTIVE [ 953.465394] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.465477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.465569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.465760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.465892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.466042] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.466165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.466244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.466409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.466488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.466669] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.466763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.466823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.466963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.467049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.467130] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2ce480c-c890-4a63-a3f7-473d0d78d8f2 is going to be updated. [ 953.468280] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.468415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.489153] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.489278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.489355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.489575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.489736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.489863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2ce480c-c890-4a63-a3f7-473d0d78d8f2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.781042] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 953.781241] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 deletion is rescheduled due to dependency. [ 953.782092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.782092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.782092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.782092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.782092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.782092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.782441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.782441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.782441] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.821584] env[63014]: INFO networking_nsxv3.common.synchronization [req-6f2456f4-3d12-4201-9386-0ac2d72ebdb0 req-736b96b5-4c1c-4abf-b789-f71ba051ed70 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 953.822634] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 953.822634] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.822634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.822634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.822995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.822995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.822995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.823253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.823300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.823402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.823497] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.022430] env[63014]: INFO networking_nsxv3.common.synchronization [None req-53dab2d4-9a64-4a04-aa32-0daeba3ce3d9 None None] Enqueued Resource ID: 2e45ccce-5fa4-4aa5-8cd0-949d09381d8a with Priority: HIGHEST for action port [ 954.022430] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e45ccce-5fa4-4aa5-8cd0-949d09381d8a with Priority: HIGHEST for action port [ 954.022430] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e45ccce-5fa4-4aa5-8cd0-949d09381d8a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.022430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e45ccce-5fa4-4aa5-8cd0-949d09381d8a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.022430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e45ccce-5fa4-4aa5-8cd0-949d09381d8a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.022430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e45ccce-5fa4-4aa5-8cd0-949d09381d8a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.022430] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e45ccce-5fa4-4aa5-8cd0-949d09381d8a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.290780] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.326791] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.326791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.326791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.327112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.327112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.327258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.327353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.327411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.328125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.328125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.328125] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 954.350688] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.350881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.350929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.351115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.351262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.360072] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 954.404419] env[63014]: INFO networking_nsxv3.common.synchronization [req-c9735c4a-ea8a-4c87-996e-f2fd8f18d2ea req-18061944-9f3d-43e4-a26a-1c1d93a89099 tempest-MigrationsAdminTest-518512597 tempest-MigrationsAdminTest-518512597-project-member] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 954.404419] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGHEST for action security_group_members [ 954.404419] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.404419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.404419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.404419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.404419] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.404419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.404419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.404843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.404843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.404843] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.523625] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e45ccce-5fa4-4aa5-8cd0-949d09381d8a [ 954.524034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.524148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.524384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.525015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.525170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.525687] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e45ccce-5fa4-4aa5-8cd0-949d09381d8a already deleted. [ 954.525899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e45ccce-5fa4-4aa5-8cd0-949d09381d8a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.557021] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.557021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.557021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.557021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.557504] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.557842] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.558119] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.561021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.561021] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.561021] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.561021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.561021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.561021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.561021] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.561021] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.561021] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.577750] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.578267] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.578610] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.580097] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.580097] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-87f1eea5-cff6-47ea-a06c-cc2101cca714 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.580097] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-87f1eea5-cff6-47ea-a06c-cc2101cca714" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.580097] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-87f1eea5-cff6-47ea-a06c-cc2101cca714" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.580446] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-87f1eea5-cff6-47ea-a06c-cc2101cca714" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.580738] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87f1eea5-cff6-47ea-a06c-cc2101cca714',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.793704] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.907617] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.907784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.907858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.908090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.908189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.908388] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.908491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.908549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.908753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.908894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.908894] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be updated. [ 954.937697] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.937697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.937697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.937697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.937697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.946795] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: IN_PROGRESS for 2s [ 955.083615] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.083836] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.083965] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.084291] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.084448] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.084608] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 87f1eea5-cff6-47ea-a06c-cc2101cca714 not found, creating... [ 955.084868] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.085040] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.085196] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.085423] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.085569] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.085854] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.086024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.086187] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.086414] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.086556] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.086758] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 87f1eea5-cff6-47ea-a06c-cc2101cca714 is going to be created. [ 955.110199] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.110436] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.111239] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.111569] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.112179] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.112179] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-87f1eea5-cff6-47ea-a06c-cc2101cca714" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.296705] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.296911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.296911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.297169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.297262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.297364] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 955.329910] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.329910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.329910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.329910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.329910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.338878] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 955.877652] env[63014]: INFO networking_nsxv3.common.synchronization [req-6f2456f4-3d12-4201-9386-0ac2d72ebdb0 req-45708aa7-05d5-4884-b655-d799f16af797 service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 955.877652] env[63014]: INFO networking_nsxv3.common.synchronization [req-6f2456f4-3d12-4201-9386-0ac2d72ebdb0 req-45708aa7-05d5-4884-b655-d799f16af797 service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 955.877652] env[63014]: INFO networking_nsxv3.common.synchronization [req-6f2456f4-3d12-4201-9386-0ac2d72ebdb0 req-45708aa7-05d5-4884-b655-d799f16af797 service nova] Enqueued Resource ID: 87f1eea5-cff6-47ea-a06c-cc2101cca714 with Priority: HIGHEST for action port [ 955.877652] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 955.877652] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 955.877652] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87f1eea5-cff6-47ea-a06c-cc2101cca714 with Priority: HIGHEST for action port [ 955.878349] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.878349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.878349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.878349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.878559] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.879584] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.879715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.879868] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-87f1eea5-cff6-47ea-a06c-cc2101cca714 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.880008] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87f1eea5-cff6-47ea-a06c-cc2101cca714" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.880053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87f1eea5-cff6-47ea-a06c-cc2101cca714" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.880809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87f1eea5-cff6-47ea-a06c-cc2101cca714" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.880913] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87f1eea5-cff6-47ea-a06c-cc2101cca714',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.153704] env[63014]: INFO networking_nsxv3.common.synchronization [None req-49600512-b7bf-4901-806f-1a72e3be7c31 None None] Enqueued Resource ID: 5d9cef72-9f53-44f8-b19a-7b8f4182d572 with Priority: HIGHEST for action port [ 956.154027] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9cef72-9f53-44f8-b19a-7b8f4182d572 with Priority: HIGHEST for action port [ 956.154644] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d9cef72-9f53-44f8-b19a-7b8f4182d572 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.154803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d9cef72-9f53-44f8-b19a-7b8f4182d572" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.155032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d9cef72-9f53-44f8-b19a-7b8f4182d572" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.155363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d9cef72-9f53-44f8-b19a-7b8f4182d572" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.155476] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d9cef72-9f53-44f8-b19a-7b8f4182d572',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.369288] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 956.369288] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 956.369452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.369566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.369849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.370109] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.370281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.370379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.370588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.370714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.370882] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.382537] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87f1eea5-cff6-47ea-a06c-cc2101cca714 with status ACTIVE [ 956.382760] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.382905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.382975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.383206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.383313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.383508] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.383641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.383738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.383961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.384100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.384365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.384493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.384570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.384738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.384837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.384931] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87f1eea5-cff6-47ea-a06c-cc2101cca714 is going to be updated. [ 956.386137] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.386245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.403104] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.403268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.403317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.403512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.403643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.403794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87f1eea5-cff6-47ea-a06c-cc2101cca714" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.657806] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d9cef72-9f53-44f8-b19a-7b8f4182d572 [ 956.658063] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.658201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.658468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.658468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.658661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.658661] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d9cef72-9f53-44f8-b19a-7b8f4182d572 already deleted. [ 956.658755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d9cef72-9f53-44f8-b19a-7b8f4182d572" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.873138] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.957424] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 in Status: SUCCESS [ 956.957745] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 deletion is rescheduled due to dependency. [ 956.961102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.354952] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 957.355261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.355420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.355637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.355832] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.355945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.356084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.356177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.356277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.356386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.356453] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.374836] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.858777] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.858996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.858996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.859311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.859532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.859646] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.859713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.859881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.859971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.860093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.860309] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.860430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.860517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.860675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.860822] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.860919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.861026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.861218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.861342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.861502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.861624] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.877408] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.877695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.877695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.877907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.877997] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.878114] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 957.905418] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.905615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.905801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.906133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.906321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.914475] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 958.363813] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ee7fd9b-59b4-4423-847c-b926a3ab5883: rpc.has_security_group_logging(os_id): False [ 958.392330] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.392489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.392551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.392758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.392850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.393165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.393273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.393332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.393492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.393571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.393766] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.393861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.393920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.394074] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.394150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.394334] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.394427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.394485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.394623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.394702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.394836] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 958.466888] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.467103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.467103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.467320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.467464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.487842] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 959.927945] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 959.927945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.927945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.927945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.927945] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.927945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.927945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.927945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.927945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.927945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.927945] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.020043] env[63014]: INFO networking_nsxv3.common.synchronization [None req-a7025c2b-4a42-4c2b-bf33-28a444b6acf7 tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_rules [ 960.020577] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_rules [ 960.020885] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.021208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.021208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.021468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.021567] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.086197] env[63014]: INFO networking_nsxv3.common.synchronization [None req-9944b4c9-a935-4548-9877-589551d0cb9d tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_rules [ 960.086798] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_rules [ 960.087118] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.087224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.435022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.435022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.435022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.435022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.435022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.435811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.435811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.435811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.435811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.435811] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.501107] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 960.501369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.539082] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.539303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.539359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.539576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.539667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.539765] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 already deleted. [ 960.539850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.540044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.540228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.540346] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.748436] env[63014]: INFO networking_nsxv3.common.synchronization [req-9b16aa3e-45ab-4321-9f21-fdd0c8d3ff1a req-2bd3ded3-db30-4222-ac9d-f624f8d8ec5a tempest-ServerActionsTestOtherB-7425835 tempest-ServerActionsTestOtherB-7425835-project-member] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 960.749109] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 960.749487] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.749673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.749771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.750175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.750336] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.750510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.750588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.750839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.750969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.751116] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.938447] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b917177-fad2-4a8d-bb56-2b4d47acad21: rpc.has_security_group_logging(os_id): False [ 960.957717] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.957847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.957915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.958145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.958611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.958611] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.958611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.958611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.958815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.958815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.959153] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.959153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.959289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.959413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.960030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.960030] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.960030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.960030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.960030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.960270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.960270] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 961.020775] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.020775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.020775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.023501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.023652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.036012] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 961.059703] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.059840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.059906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.060161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.060230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.060315] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 already deleted. [ 961.060391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.078104] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.078104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.078104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.078104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.078104] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.078104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.078104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.078452] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.078493] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.078751] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.078880] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.078995] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.079123] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.079238] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.079350] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.080533] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.115230] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.115339] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 961.115479] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.115659] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.115974] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-c542343a-120c-4946-b44c-140be85d7e5c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.116162] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-c542343a-120c-4946-b44c-140be85d7e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.116400] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-c542343a-120c-4946-b44c-140be85d7e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.116720] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-c542343a-120c-4946-b44c-140be85d7e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.116866] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c542343a-120c-4946-b44c-140be85d7e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.257121] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.257292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.257361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.257568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.257658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.257871] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.257986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.258059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.258202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.258284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.258371] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 already deleted. [ 961.258442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.526550] env[63014]: INFO networking_nsxv3.common.synchronization [req-7e78de77-8793-403c-95b8-850837dbcfb5 req-c5182d81-c5ff-4ed3-a5ea-77ac41153db9 tempest-InstanceActionsTestJSON-572112520 tempest-InstanceActionsTestJSON-572112520-project-member] Enqueued Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGHEST for action security_group_members [ 961.527081] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGHEST for action security_group_members [ 961.527382] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-294457ec-0617-4c91-a38e-e6195397f5a3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.527493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.527578] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.527753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.527901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.527997] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.528325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.528759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.528858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.528957] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.618978] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.619163] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.619335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.619658] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.619847] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.620147] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port c542343a-120c-4946-b44c-140be85d7e5c not found, creating... [ 961.620358] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.620561] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.620716] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.620994] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.621202] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.621549] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.621773] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.621917] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.622674] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.622674] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.622674] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: c542343a-120c-4946-b44c-140be85d7e5c is going to be created. [ 961.642651] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.642651] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.642651] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.643220] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.643220] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.643327] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-c542343a-120c-4946-b44c-140be85d7e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.031309] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.031594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.031594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.031762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.031858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.032078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.032188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.032244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.032397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.032477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.032567] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 294457ec-0617-4c91-a38e-e6195397f5a3 is going to be updated. [ 962.057841] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.057994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.058080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.058279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.058422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.066767] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 294457ec-0617-4c91-a38e-e6195397f5a3 in Status: IN_PROGRESS for 2s [ 962.327632] env[63014]: INFO networking_nsxv3.common.synchronization [req-9b16aa3e-45ab-4321-9f21-fdd0c8d3ff1a req-7ba8758d-f7d1-4757-8720-97506d657a0e service nova] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 962.328079] env[63014]: INFO networking_nsxv3.common.synchronization [req-9b16aa3e-45ab-4321-9f21-fdd0c8d3ff1a req-7ba8758d-f7d1-4757-8720-97506d657a0e service nova] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 962.328079] env[63014]: INFO networking_nsxv3.common.synchronization [req-9b16aa3e-45ab-4321-9f21-fdd0c8d3ff1a req-7ba8758d-f7d1-4757-8720-97506d657a0e service nova] Enqueued Resource ID: c542343a-120c-4946-b44c-140be85d7e5c with Priority: HIGHEST for action port [ 962.328504] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 962.328640] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 962.328738] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c542343a-120c-4946-b44c-140be85d7e5c with Priority: HIGHEST for action port [ 962.329012] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.332112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.332112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.332112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.332112] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.332749] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.332858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.332926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.333256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.333322] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.333418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.333462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.333616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.333700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.333790] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.338665] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-c542343a-120c-4946-b44c-140be85d7e5c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.338796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c542343a-120c-4946-b44c-140be85d7e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.338850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c542343a-120c-4946-b44c-140be85d7e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.339023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c542343a-120c-4946-b44c-140be85d7e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.339094] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c542343a-120c-4946-b44c-140be85d7e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.841061] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.842061] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.842192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.844652] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c542343a-120c-4946-b44c-140be85d7e5c with status ACTIVE [ 962.845100] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.845100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.845100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.845303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.845397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.845715] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.845715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.845715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.845863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.845924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.846093] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.846251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.846294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.846446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.847562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.847673] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c542343a-120c-4946-b44c-140be85d7e5c is going to be updated. [ 962.867957] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.868139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.868207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.868366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.868799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.868799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c542343a-120c-4946-b44c-140be85d7e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.048831] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 963.049143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.101687] env[63014]: INFO networking_nsxv3.common.synchronization [req-48620892-8686-4b2c-968a-ffb8453672f6 req-c06dd1fd-a925-4c94-9cf9-202d873eaad0 tempest-AttachVolumeShelveTestJSON-960433482 tempest-AttachVolumeShelveTestJSON-960433482-project-member] Enqueued Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_members [ 963.101972] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_members [ 963.102334] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.102484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.102575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.102852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.103067] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.103240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.103319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.103480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.103566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.103660] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.345658] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.437835] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.438079] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.438259] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.438599] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.438923] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.439139] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.439335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.439593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.439791] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.440061] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.440498] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.440498] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.440498] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.440756] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 963.440844] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.441053] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.475829] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.475997] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 963.476217] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.476413] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.476737] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-a79337cb-17e6-4dc8-be90-90a6d3823771 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.476951] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.477103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.477513] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.477772] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79337cb-17e6-4dc8-be90-90a6d3823771',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.606116] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.606339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.606421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.606631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.606721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.606922] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.607029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.607095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.607236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.607313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.607405] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 already deleted. [ 963.607492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.847997] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.848882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.849022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.849220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.849318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.849424] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be created. [ 963.874281] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.874484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.874563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.874770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.874955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.883904] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: UNINITIALIZED for 2s [ 963.980342] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.980572] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.980704] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.981017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.981190] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.981359] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port a79337cb-17e6-4dc8-be90-90a6d3823771 not found, creating... [ 963.981628] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.981794] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.981919] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.982158] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.982303] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.982586] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.982744] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.982865] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.983111] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.983308] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.983464] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: a79337cb-17e6-4dc8-be90-90a6d3823771 is going to be created. [ 964.001504] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.001690] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.001817] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.002069] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.002286] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.002501] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.076962] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 294457ec-0617-4c91-a38e-e6195397f5a3 in Status: SUCCESS [ 964.076962] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 294457ec-0617-4c91-a38e-e6195397f5a3 deletion is rescheduled due to dependency. [ 964.076962] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.787587] env[63014]: INFO networking_nsxv3.common.synchronization [req-48620892-8686-4b2c-968a-ffb8453672f6 req-3aa44105-9b21-489e-b5d1-0b878b202c4a service nova] Enqueued Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_rules [ 964.787798] env[63014]: INFO networking_nsxv3.common.synchronization [req-48620892-8686-4b2c-968a-ffb8453672f6 req-3aa44105-9b21-489e-b5d1-0b878b202c4a service nova] Enqueued Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_members [ 964.787912] env[63014]: INFO networking_nsxv3.common.synchronization [req-48620892-8686-4b2c-968a-ffb8453672f6 req-3aa44105-9b21-489e-b5d1-0b878b202c4a service nova] Enqueued Resource ID: a79337cb-17e6-4dc8-be90-90a6d3823771 with Priority: HIGHEST for action port [ 964.788161] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_rules [ 964.788284] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_members [ 964.788376] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79337cb-17e6-4dc8-be90-90a6d3823771 with Priority: HIGHEST for action port [ 964.788932] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.789982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.790085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.790291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.790370] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.791170] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.791274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.791337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.791499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.791640] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.791730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.791789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.791927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.792362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.792453] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.793199] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-a79337cb-17e6-4dc8-be90-90a6d3823771 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.793326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.793375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.793509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.793576] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79337cb-17e6-4dc8-be90-90a6d3823771',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.295274] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.295608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.297313] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.297688] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a79337cb-17e6-4dc8-be90-90a6d3823771 with status ACTIVE [ 965.297905] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.298046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.298090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.298324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.298456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.298703] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.298763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.298798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.298970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.299066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.300245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.300245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.300245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.300245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.300245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.300245] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a79337cb-17e6-4dc8-be90-90a6d3823771 is going to be updated. [ 965.319854] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.320348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.320348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.320348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.320481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.320515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.802998] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.895833] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 965.895833] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.895833] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.896409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.896409] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.896409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.896409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.896565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.896633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.896722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.896835] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.308546] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.308840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.308840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.309037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.309106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.309202] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 is going to be created. [ 966.331196] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.331337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.331441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.331617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.331781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.340603] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: UNINITIALIZED for 2s [ 966.399113] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.556405] env[63014]: INFO networking_nsxv3.common.synchronization [req-68f4b767-589c-422a-82bb-89d11c7514e9 req-b3c6afe4-acd7-462b-97b2-c325131b40a9 tempest-ServerTagsTestJSON-1976775330 tempest-ServerTagsTestJSON-1976775330-project-member] Enqueued Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGHEST for action security_group_members [ 966.556946] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGHEST for action security_group_members [ 966.557271] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb735ae-137c-4021-8f15-a132e8df5b1b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.557387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.557460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.557740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.557914] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.558042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.558109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.558310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.558669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.558669] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.853036] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-276 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.853286] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-276" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.853482] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-276" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.853760] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-276" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.854413] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.854652] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.854732] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.854978] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.855121] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.855367] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.855491] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.855620] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.855735] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.855852] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 966.855962] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.856138] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.876531] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.876701] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 966.876842] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.877098] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-276" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.877354] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.877533] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.877659] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.877991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.878152] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632d6ddf-14b7-45f1-b950-6dca5b21ef0f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.901746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db110989-027c-4ed8-b5db-6b256912c344: rpc.has_security_group_logging(os_id): False [ 966.921124] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.921124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.921124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.921313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.921375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.921625] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.921729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.921792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.921941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.922044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.922112] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be created. [ 966.978643] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.978643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.978643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.978643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.979042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.988851] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 967.060546] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.060677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.060719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.060946] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.061066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.061275] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.061381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.061444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.061603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.061683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.061770] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b already deleted. [ 967.061851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.384537] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.384847] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.384847] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.385233] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.385809] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.385809] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 632d6ddf-14b7-45f1-b950-6dca5b21ef0f not found, creating... [ 967.385962] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.386050] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.386134] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.386385] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.386535] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.386834] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.386998] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.387733] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.387733] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.387733] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.387733] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 632d6ddf-14b7-45f1-b950-6dca5b21ef0f is going to be created. [ 967.411026] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.411400] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.411494] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.411810] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.412098] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.412364] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.300269] env[63014]: INFO networking_nsxv3.common.synchronization [req-68f4b767-589c-422a-82bb-89d11c7514e9 req-5455712a-1174-47d7-bbc1-f99e9b518971 service nova] Enqueued Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGHEST for action security_group_rules [ 968.300551] env[63014]: INFO networking_nsxv3.common.synchronization [req-68f4b767-589c-422a-82bb-89d11c7514e9 req-5455712a-1174-47d7-bbc1-f99e9b518971 service nova] Enqueued Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGHEST for action security_group_members [ 968.300753] env[63014]: INFO networking_nsxv3.common.synchronization [req-68f4b767-589c-422a-82bb-89d11c7514e9 req-5455712a-1174-47d7-bbc1-f99e9b518971 service nova] Enqueued Resource ID: 632d6ddf-14b7-45f1-b950-6dca5b21ef0f with Priority: HIGHEST for action port [ 968.301563] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGHEST for action security_group_rules [ 968.301756] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGHEST for action security_group_members [ 968.301938] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 632d6ddf-14b7-45f1-b950-6dca5b21ef0f with Priority: HIGHEST for action port [ 968.303603] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb735ae-137c-4021-8f15-a132e8df5b1b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.303603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.303603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.303603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.303603] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.304768] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb735ae-137c-4021-8f15-a132e8df5b1b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.304768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.305429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.305722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.305955] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.306142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.306620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.306869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.307028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.309675] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.311134] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.311314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.311414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.311657] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.311752] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('632d6ddf-14b7-45f1-b950-6dca5b21ef0f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.356054] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: SUCCESS [ 968.356191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.356306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.356577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.356804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.358105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.358105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.358105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.358105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.358105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.358105] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.813932] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb735ae-137c-4021-8f15-a132e8df5b1b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.814263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.814263] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.815166] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 632d6ddf-14b7-45f1-b950-6dca5b21ef0f with status ACTIVE [ 968.815431] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.815609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.815719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.815999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.816170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.816416] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.816565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.816667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.816907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.817045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.817344] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.817878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.817878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.817878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.818296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.818296] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 632d6ddf-14b7-45f1-b950-6dca5b21ef0f is going to be updated. [ 968.837984] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.838144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.838215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.838491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.838753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.838838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-632d6ddf-14b7-45f1-b950-6dca5b21ef0f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.861949] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.002459] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 969.002638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.059536] env[63014]: INFO networking_nsxv3.common.synchronization [req-0dbf0351-b7d2-4967-96d8-785d3909738c req-ab46e16e-2a61-434c-83a3-520de92f0539 tempest-ListServerFiltersTestJSON-1757136692 tempest-ListServerFiltersTestJSON-1757136692-project-member] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 969.060138] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 969.060542] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.060679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.060745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.061634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.061634] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.061634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.061634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.061865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.061865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.061940] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.322066] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.367028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f73f976-0a71-450e-b4d0-b6746ce641e7: rpc.has_security_group_logging(os_id): False [ 969.386023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.386023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.386023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.386023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.386023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.386023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.386023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.386023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.386023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.386023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.386023] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 is going to be created. [ 969.445817] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.446179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.447936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.447936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.447936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.456663] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: IN_PROGRESS for 2s [ 969.507309] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.507309] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.507309] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.507309] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.507309] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.507309] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.507309] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.508551] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.509011] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.509411] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.509659] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.509884] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.510182] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.510455] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 969.511493] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.511493] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.530638] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.530842] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 969.531085] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.531291] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.531646] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-2e587ddb-20f2-41e5-b4e0-08e07821395c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.531809] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-2e587ddb-20f2-41e5-b4e0-08e07821395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.531943] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-2e587ddb-20f2-41e5-b4e0-08e07821395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.532297] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-2e587ddb-20f2-41e5-b4e0-08e07821395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.532452] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e587ddb-20f2-41e5-b4e0-08e07821395c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.564316] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.564473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.564539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.564756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.564937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.565055] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.565160] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.565270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.565402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.565482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.565567] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e already deleted. [ 969.565768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.824479] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.824734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.824734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.824982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.825088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.825351] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b is going to be created. [ 969.848776] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.848925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.848990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.849255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.849412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.860568] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b in Status: UNINITIALIZED for 2s [ 970.036170] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.036505] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.036647] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.036958] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.037141] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.037310] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 2e587ddb-20f2-41e5-b4e0-08e07821395c not found, creating... [ 970.037608] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.037765] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.037913] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.038177] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.038323] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.038631] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.038808] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.038945] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.039205] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.039351] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.039512] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 2e587ddb-20f2-41e5-b4e0-08e07821395c is going to be created. [ 970.058676] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.058867] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.058965] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.059290] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.059524] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.059766] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-2e587ddb-20f2-41e5-b4e0-08e07821395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.789921] env[63014]: INFO networking_nsxv3.common.synchronization [req-0dbf0351-b7d2-4967-96d8-785d3909738c req-56690d63-7859-4ff9-8b0d-7010a3849dd0 service nova] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_rules [ 970.790136] env[63014]: INFO networking_nsxv3.common.synchronization [req-0dbf0351-b7d2-4967-96d8-785d3909738c req-56690d63-7859-4ff9-8b0d-7010a3849dd0 service nova] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 970.790282] env[63014]: INFO networking_nsxv3.common.synchronization [req-0dbf0351-b7d2-4967-96d8-785d3909738c req-56690d63-7859-4ff9-8b0d-7010a3849dd0 service nova] Enqueued Resource ID: 2e587ddb-20f2-41e5-b4e0-08e07821395c with Priority: HIGHEST for action port [ 970.790539] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_rules [ 970.790656] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 970.790763] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e587ddb-20f2-41e5-b4e0-08e07821395c with Priority: HIGHEST for action port [ 970.791344] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.791483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.791575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.791776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.791856] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.792685] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.792813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.792876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.793026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.793226] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.793300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.793346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.793940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.793940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.793940] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.794612] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e587ddb-20f2-41e5-b4e0-08e07821395c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.794612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e587ddb-20f2-41e5-b4e0-08e07821395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.794612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e587ddb-20f2-41e5-b4e0-08e07821395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.796670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e587ddb-20f2-41e5-b4e0-08e07821395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.796670] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e587ddb-20f2-41e5-b4e0-08e07821395c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.298395] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.299530] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.299643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.299799] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e587ddb-20f2-41e5-b4e0-08e07821395c with status ACTIVE [ 971.299979] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.300110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.300191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.300414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.300517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.300710] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.300808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.300864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.301025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.301116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.301315] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.301437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.301474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.301600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.301694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.301781] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e587ddb-20f2-41e5-b4e0-08e07821395c is going to be updated. [ 971.321805] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.321933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.322020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.322241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.322376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.322538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e587ddb-20f2-41e5-b4e0-08e07821395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.469991] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: SUCCESS [ 971.470222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.667435] env[63014]: INFO networking_nsxv3.common.synchronization [req-00732710-f691-4c62-b7c6-17000b53f2ec req-b30e901a-e85d-4431-849f-d2fd6b7a3809 tempest-ListServerFiltersTestJSON-1757136692 tempest-ListServerFiltersTestJSON-1757136692-project-member] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 971.668224] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 971.668224] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.668406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.804549] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.874117] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b in Status: SUCCESS [ 971.874424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.875267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.875552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.875895] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.876773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.876872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.877092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.877206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.877334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.877428] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.082572] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.082965] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.082965] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.083278] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.083552] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.083751] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.083883] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.084224] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.084411] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.084654] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.084800] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.084938] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.085089] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.085361] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.085520] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.085701] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.103454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.103632] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.103817] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.104252] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.104675] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-35941f95-8fdd-449e-937e-b643ac2b7cd2 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.104914] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-35941f95-8fdd-449e-937e-b643ac2b7cd2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.105290] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-35941f95-8fdd-449e-937e-b643ac2b7cd2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.105481] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-35941f95-8fdd-449e-937e-b643ac2b7cd2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.105676] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35941f95-8fdd-449e-937e-b643ac2b7cd2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.306901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.307289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.307289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.307383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.307487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.307578] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be created. [ 972.329708] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.329896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.329896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.330126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.330286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.341019] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: UNINITIALIZED for 2s [ 972.379769] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb735ae-137c-4021-8f15-a132e8df5b1b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.380042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.380042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.380198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.380385] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.380491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.380561] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.380748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.380844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.380939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.381149] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb735ae-137c-4021-8f15-a132e8df5b1b taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.381275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.382011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.382011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.382011] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.382011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.382011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.382447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.382575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.382712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.382804] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.607925] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.608339] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.608587] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.608963] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.609218] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.609550] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 35941f95-8fdd-449e-937e-b643ac2b7cd2 not found, creating... [ 972.609848] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.610075] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.610246] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.610503] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.610780] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.611128] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.611317] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.611445] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.611682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.611880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.612113] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 35941f95-8fdd-449e-937e-b643ac2b7cd2 is going to be created. [ 972.664226] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.664502] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.664598] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.664946] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.665271] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.665581] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-35941f95-8fdd-449e-937e-b643ac2b7cd2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.887635] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cb735ae-137c-4021-8f15-a132e8df5b1b: rpc.has_security_group_logging(os_id): False [ 972.918219] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.918436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.918436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.918627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.918714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.919229] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.919229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.919522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.919522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.919522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.919726] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.919820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.919876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.919992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.920274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.920462] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.920554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.920620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.920749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.920828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.920899] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b is going to be created. [ 972.975460] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.975715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.975820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.976045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.976347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.987961] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b in Status: IN_PROGRESS for 2s [ 973.704293] env[63014]: INFO networking_nsxv3.common.synchronization [req-00732710-f691-4c62-b7c6-17000b53f2ec req-2b1ca438-5ff7-4505-8388-679d8665ec91 service nova] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_rules [ 973.704293] env[63014]: INFO networking_nsxv3.common.synchronization [req-00732710-f691-4c62-b7c6-17000b53f2ec req-2b1ca438-5ff7-4505-8388-679d8665ec91 service nova] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 973.704293] env[63014]: INFO networking_nsxv3.common.synchronization [req-00732710-f691-4c62-b7c6-17000b53f2ec req-2b1ca438-5ff7-4505-8388-679d8665ec91 service nova] Enqueued Resource ID: 35941f95-8fdd-449e-937e-b643ac2b7cd2 with Priority: HIGHEST for action port [ 973.704293] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_rules [ 973.704293] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 973.704293] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35941f95-8fdd-449e-937e-b643ac2b7cd2 with Priority: HIGHEST for action port [ 973.705912] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.706288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.706780] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.707010] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.707462] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-35941f95-8fdd-449e-937e-b643ac2b7cd2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.708744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35941f95-8fdd-449e-937e-b643ac2b7cd2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.708744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35941f95-8fdd-449e-937e-b643ac2b7cd2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.708744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35941f95-8fdd-449e-937e-b643ac2b7cd2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.708744] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35941f95-8fdd-449e-937e-b643ac2b7cd2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.211629] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35941f95-8fdd-449e-937e-b643ac2b7cd2 with status ACTIVE [ 974.211629] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.211629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.211629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.211629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.211629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.211930] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.211930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.212019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.212224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.212224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.212390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.212517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.212606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.213698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.213698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.213698] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35941f95-8fdd-449e-937e-b643ac2b7cd2 is going to be updated. [ 974.238163] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.238318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.238379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.238601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.238745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.239086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35941f95-8fdd-449e-937e-b643ac2b7cd2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.349767] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 974.350106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.350329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.350611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.350875] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.352592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.352592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.352592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.352892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.353658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.353810] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.354773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.354980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.355228] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.355370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.355423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.355604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.355689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.355800] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.857364] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.857736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.863512] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.000313] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b in Status: SUCCESS [ 975.000904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.366037] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.868314] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.869038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.869038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.869038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.869038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.869038] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 975.897390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.897390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.897684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.897684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.897847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.909378] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 977.920293] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 977.920612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.920800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.921075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.921315] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.921522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.921638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.921842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.921980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.922143] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.424130] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.707626] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 978.707772] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 978.765912] env[63014]: INFO networking_nsxv3.common.synchronization [req-c80fc641-bc61-4fb1-b6a5-c9c933b8d159 req-ac6f9b2c-236f-42e2-9a6d-e7843ace79bd tempest-ListServerFiltersTestJSON-1757136692 tempest-ListServerFiltersTestJSON-1757136692-project-member] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 978.766556] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 978.767786] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.767786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.926910] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.163211] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-413 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.163211] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.163211] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.163211] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.163839] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.164229] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.164518] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.167017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.167017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.167017] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.167017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.167017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.167017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.167017] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 979.167017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.167017] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.187030] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.187030] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 979.187030] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.187030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-413" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.187030] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-b8d4791b-593b-4cee-b989-3c7d478035a0 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.187030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-b8d4791b-593b-4cee-b989-3c7d478035a0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.187030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-b8d4791b-593b-4cee-b989-3c7d478035a0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.187030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-b8d4791b-593b-4cee-b989-3c7d478035a0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.187030] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8d4791b-593b-4cee-b989-3c7d478035a0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.429899] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.430132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.430190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.430472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.430618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.430739] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 979.468128] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.468303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.468374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.468589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.468767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.477980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 979.689777] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.689991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.690167] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.690493] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.690655] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.690817] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port b8d4791b-593b-4cee-b989-3c7d478035a0 not found, creating... [ 979.694323] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.694545] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.694724] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.695079] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.695289] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.695645] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.695979] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.695979] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.698315] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.698315] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.698315] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: b8d4791b-593b-4cee-b989-3c7d478035a0 is going to be created. [ 979.717680] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.717906] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.718052] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.718342] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.718586] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.718808] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-b8d4791b-593b-4cee-b989-3c7d478035a0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.829247] env[63014]: INFO networking_nsxv3.common.synchronization [req-ac3bff71-3fad-42d2-a9c8-1b79e33f07f7 req-f1fba3b0-3ddb-4fe6-a4ae-af203fbdb7ac tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 979.829247] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 979.829247] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.829247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.829247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.829247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.829247] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.829247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.829247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.829247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.830263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.830521] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.333691] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.333951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.333951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.334565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.334565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.334706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.334795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.334883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.335124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.335251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.335349] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 980.361442] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.361541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.361731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.361911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.362085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.369807] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 980.463073] env[63014]: INFO networking_nsxv3.common.synchronization [req-c80fc641-bc61-4fb1-b6a5-c9c933b8d159 req-de15cfe4-6654-472c-a023-cfab918ec9af service nova] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_rules [ 980.463271] env[63014]: INFO networking_nsxv3.common.synchronization [req-c80fc641-bc61-4fb1-b6a5-c9c933b8d159 req-de15cfe4-6654-472c-a023-cfab918ec9af service nova] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 980.463417] env[63014]: INFO networking_nsxv3.common.synchronization [req-c80fc641-bc61-4fb1-b6a5-c9c933b8d159 req-de15cfe4-6654-472c-a023-cfab918ec9af service nova] Enqueued Resource ID: b8d4791b-593b-4cee-b989-3c7d478035a0 with Priority: HIGHEST for action port [ 980.463642] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_rules [ 980.463769] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 980.463867] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8d4791b-593b-4cee-b989-3c7d478035a0 with Priority: HIGHEST for action port [ 980.464428] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.464535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.464724] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.464808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.464980] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8d4791b-593b-4cee-b989-3c7d478035a0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.465093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8d4791b-593b-4cee-b989-3c7d478035a0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.465156] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8d4791b-593b-4cee-b989-3c7d478035a0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.465384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8d4791b-593b-4cee-b989-3c7d478035a0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.465466] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8d4791b-593b-4cee-b989-3c7d478035a0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.967188] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8d4791b-593b-4cee-b989-3c7d478035a0 with status ACTIVE [ 980.967474] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.967631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.967710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.967925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.968039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.968218] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.968326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.968387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.968540] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.968619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.968815] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.968908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.968967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.969142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.969224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.969352] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8d4791b-593b-4cee-b989-3c7d478035a0 is going to be updated. [ 980.988642] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.988872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.988872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.989102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.989285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.989485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8d4791b-593b-4cee-b989-3c7d478035a0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.432708] env[63014]: INFO networking_nsxv3.common.synchronization [req-c28060cd-c7d5-4fd4-8928-00fcdec6e13e req-ae686b69-2ad3-4c13-8ca7-76fb3d68ce6a tempest-ServerTagsTestJSON-1976775330 tempest-ServerTagsTestJSON-1976775330-project-member] Enqueued Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGHEST for action security_group_members [ 981.433293] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGHEST for action security_group_members [ 981.433607] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cb735ae-137c-4021-8f15-a132e8df5b1b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.433725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.433792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.433996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.434301] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.434415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.434481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.434648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.434740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.435086] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.487850] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 981.488092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.488249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.488479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.488668] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.488773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.488848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.488998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.489091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.489177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.489338] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.489417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.489478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.489616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.489751] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.489843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.489897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.490050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.490129] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.490209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.490303] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.491067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.491231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.491377] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.491478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.491541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.491665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.491735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.491821] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.938680] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.938680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.938680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.938680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.938680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.938949] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.938949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.939060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.939324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.939519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.939519] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b is going to be updated. [ 981.965712] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.965850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.965911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.966147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.966730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.974064] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b in Status: IN_PROGRESS for 2s [ 981.993409] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eea1ff77-b509-4f98-a878-bf09a64faa0e: rpc.has_security_group_logging(os_id): False [ 981.994954] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.010403] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.010576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.010634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.010826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.010922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.011147] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.011246] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.011303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.011456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.011544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.011718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.011810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.011871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.012041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.012098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.012267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.012357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.012410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.012546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.012619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.012704] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be created. [ 982.068396] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.068627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.068627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.068857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.069071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.080403] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 982.379373] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 982.379373] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 982.379373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.497857] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.625323] env[63014]: INFO networking_nsxv3.common.synchronization [req-48eb2c06-cab9-40f8-a3d7-5de2dcbb2009 req-10ea1831-842f-4fdd-91e5-ee1e4a962066 tempest-ServersTestJSON-516703967 tempest-ServersTestJSON-516703967-project-member] Enqueued Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_members [ 982.625874] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGHEST for action security_group_members [ 982.626189] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.626339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.626411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.626600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.626750] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.626846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.626939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.627304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.627304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.627304] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.003176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.003176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.003176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.003176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.003176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.003176] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 983.032852] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.033204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.033204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.033363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.033418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.042439] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 983.129036] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.129211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.129284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.129529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.129597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.129792] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.129891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.129953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.130121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.130296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.130296] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb is going to be updated. [ 983.164179] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.164325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.164411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.164674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.164847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.174421] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb in Status: IN_PROGRESS for 2s [ 983.984808] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b in Status: SUCCESS [ 983.985222] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b deletion is rescheduled due to dependency. [ 983.985222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.092191] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 984.092408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.092571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.092788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.092873] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.597266] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.597266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.050909] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 985.051190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.051310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.051526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.051710] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.051825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.051889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.052053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.052164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.052232] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.183399] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb in Status: SUCCESS [ 985.183399] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb deletion is rescheduled due to dependency. [ 985.183399] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.556562] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.058499] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.561711] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.561907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.561994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.562282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.562388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.562502] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 986.589241] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.589241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.589241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.589502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.589647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.596906] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 986.678305] env[63014]: INFO networking_nsxv3.common.synchronization [req-3a76d488-2af8-4cea-b8de-e0190bd4d730 req-17cfc539-eae9-484b-a2d3-bf0a7e1c212b tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 986.678495] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 986.678850] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.678978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.679055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.679307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.679470] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.679570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.679651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.679856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.679963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.680125] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.913995] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.914211] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.914335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.914598] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.914852] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.915034] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.915136] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.915417] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.915575] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.916218] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.916218] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.916218] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.916218] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.916442] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.916442] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.916565] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.935930] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.936118] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.936279] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.937030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.937030] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-ec058b83-29e1-477a-901d-24a02de6b362 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.937030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-ec058b83-29e1-477a-901d-24a02de6b362" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.937030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-ec058b83-29e1-477a-901d-24a02de6b362" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.937335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-ec058b83-29e1-477a-901d-24a02de6b362" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.937487] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec058b83-29e1-477a-901d-24a02de6b362',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.182315] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.182649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.182649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.182815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.182901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.183121] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.183220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.183283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.183429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.183505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.183590] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 already deleted. [ 987.183670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.439787] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.440029] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.440167] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.440463] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.440642] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.440794] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port ec058b83-29e1-477a-901d-24a02de6b362 not found, creating... [ 987.441064] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.441242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.441352] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.441584] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.441731] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.442031] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.442208] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.442322] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.442537] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.442676] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.442820] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: ec058b83-29e1-477a-901d-24a02de6b362 is going to be created. [ 987.461864] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.462104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.462234] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.462529] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.462757] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.463018] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-ec058b83-29e1-477a-901d-24a02de6b362" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.180473] env[63014]: INFO networking_nsxv3.common.synchronization [req-3a76d488-2af8-4cea-b8de-e0190bd4d730 req-8a838bb9-1318-48d3-b46f-d50453a2b03c service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 988.180716] env[63014]: INFO networking_nsxv3.common.synchronization [req-3a76d488-2af8-4cea-b8de-e0190bd4d730 req-8a838bb9-1318-48d3-b46f-d50453a2b03c service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 988.180865] env[63014]: INFO networking_nsxv3.common.synchronization [req-3a76d488-2af8-4cea-b8de-e0190bd4d730 req-8a838bb9-1318-48d3-b46f-d50453a2b03c service nova] Enqueued Resource ID: ec058b83-29e1-477a-901d-24a02de6b362 with Priority: HIGHEST for action port [ 988.181123] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 988.181253] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 988.181350] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec058b83-29e1-477a-901d-24a02de6b362 with Priority: HIGHEST for action port [ 988.181914] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.183270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.183515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.183806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.183806] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.189018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.189018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.189018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.189018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec058b83-29e1-477a-901d-24a02de6b362 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec058b83-29e1-477a-901d-24a02de6b362" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec058b83-29e1-477a-901d-24a02de6b362" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.189018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec058b83-29e1-477a-901d-24a02de6b362" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.189018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec058b83-29e1-477a-901d-24a02de6b362',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.606912] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 988.607920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.607920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.607920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.607920] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.607920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.607920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.608185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.608185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.608230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.608311] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.690487] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.690487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.691730] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.694158] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec058b83-29e1-477a-901d-24a02de6b362 with status ACTIVE [ 988.694400] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.694545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.694609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.694820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.694916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.695110] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.695210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.695272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.695675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.695675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.695675] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.695799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.695799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.695943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.696013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.696102] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec058b83-29e1-477a-901d-24a02de6b362 is going to be updated. [ 988.715332] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.715488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.715549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.715732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.715860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.716015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec058b83-29e1-477a-901d-24a02de6b362" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.110057] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.110218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.110330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.110520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.110794] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.110865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.110907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.111051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.111139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.111235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.111380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.111463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.111584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.111655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.111785] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.111879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.111924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.112067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.112142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.112251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.112316] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.194054] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.614130] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eea1ff77-b509-4f98-a878-bf09a64faa0e: rpc.has_security_group_logging(os_id): False [ 989.634092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.634092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.634092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.634219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.634290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.634529] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.634626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.634695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.634845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.634918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.635104] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.635189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.635245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.636457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.636457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.636457] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.636457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.636457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.636457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.636457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.636457] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 989.696418] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.697183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.697344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.697627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.697731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.697854] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be created. [ 989.700568] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.700719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.700819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.701066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.701255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.713233] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 989.722616] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.722792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.722876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.723134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.723321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.731125] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: UNINITIALIZED for 2s [ 990.332692] env[63014]: INFO networking_nsxv3.common.synchronization [req-d8d9d2f4-5445-4ace-b438-8aaa8c38838b req-994f5675-ef9c-405c-bd69-5dc9e641bd2e tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 990.333656] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 990.333959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.334204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.334275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.334552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.334722] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.334827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.334895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.335056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.335142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.335234] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.681468] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.681686] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.681819] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.682178] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.682457] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.682623] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.682746] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.682971] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.683302] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.683539] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.683661] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.683774] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.683885] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.683996] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 990.684115] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.684253] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.706439] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.706684] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 990.706868] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.707139] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.707655] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-461cf737-527e-4fc4-85a7-444146e20fbf taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.707945] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-461cf737-527e-4fc4-85a7-444146e20fbf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.708201] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-461cf737-527e-4fc4-85a7-444146e20fbf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.708655] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-461cf737-527e-4fc4-85a7-444146e20fbf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.708843] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('461cf737-527e-4fc4-85a7-444146e20fbf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.764906] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 990.765030] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent loop - iteration:2 started [ 990.837556] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.837697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.837697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.838411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.838411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.838411] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.838411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.838411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.838701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.838701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.838701] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 already deleted. [ 990.838701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.211999] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.211999] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.211999] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.212251] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.212398] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.212611] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 461cf737-527e-4fc4-85a7-444146e20fbf not found, creating... [ 991.212969] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.213160] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.213322] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.213525] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.213717] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.214073] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.214338] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.214518] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.214787] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.214943] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.215203] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 461cf737-527e-4fc4-85a7-444146e20fbf is going to be created. [ 991.241557] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.241838] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.241963] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.242312] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.242589] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.242891] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-461cf737-527e-4fc4-85a7-444146e20fbf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.734943] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 991.734943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.734943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.734943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.734943] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.740278] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 991.740278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.740278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.740278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.740278] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.740278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.740278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.740278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.740278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.740278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.740278] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.939338] env[63014]: INFO networking_nsxv3.common.synchronization [req-d8d9d2f4-5445-4ace-b438-8aaa8c38838b req-d2bd91d1-666a-47f6-a552-51f20013e239 service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 991.939338] env[63014]: INFO networking_nsxv3.common.synchronization [req-d8d9d2f4-5445-4ace-b438-8aaa8c38838b req-d2bd91d1-666a-47f6-a552-51f20013e239 service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 991.939338] env[63014]: INFO networking_nsxv3.common.synchronization [req-d8d9d2f4-5445-4ace-b438-8aaa8c38838b req-d2bd91d1-666a-47f6-a552-51f20013e239 service nova] Enqueued Resource ID: 461cf737-527e-4fc4-85a7-444146e20fbf with Priority: HIGHEST for action port [ 991.939338] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 991.939338] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 991.939338] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 461cf737-527e-4fc4-85a7-444146e20fbf with Priority: HIGHEST for action port [ 991.939711] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.939944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.940153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.940484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.940647] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.941861] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.942236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.942392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.942632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.942853] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.943059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.943195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.943499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.943656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.943810] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.944729] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-461cf737-527e-4fc4-85a7-444146e20fbf taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.944952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-461cf737-527e-4fc4-85a7-444146e20fbf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.945121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-461cf737-527e-4fc4-85a7-444146e20fbf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.945379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-461cf737-527e-4fc4-85a7-444146e20fbf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.945547] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('461cf737-527e-4fc4-85a7-444146e20fbf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.236843] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.236843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.236843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.237601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.237601] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.237601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.237601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.237768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.237798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.237901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.238039] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.241664] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.241780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.241849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.242022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.242241] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.242372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.242462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.242675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.242753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.243097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.243097] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.243097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.243235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.243302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.243482] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.243608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.243690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.243855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.243959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.244076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.244229] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.447379] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.447519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.447721] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.448637] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 461cf737-527e-4fc4-85a7-444146e20fbf with status ACTIVE [ 992.450050] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.450050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.450050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.450374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.450590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.450785] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.450882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.450940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.451311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.451396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.451571] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.451659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.451740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.452030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.452305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.452421] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 461cf737-527e-4fc4-85a7-444146e20fbf is going to be updated. [ 992.473326] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.473477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.473545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.473801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.473867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.474052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-461cf737-527e-4fc4-85a7-444146e20fbf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.741189] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.741189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.741189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.744020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.744020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.744020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.744020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.744020] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.748417] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7e639c-697c-438d-b550-983a53fa2d55: rpc.has_security_group_logging(os_id): False [ 992.753028] env[63014]: INFO networking_nsxv3.common.synchronization [req-3f1a3c4d-1509-4c6e-bf0d-06127db6fedf req-5ba41308-223b-4897-9301-469a8f13ae12 tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_members [ 992.753028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_members [ 992.755263] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.755564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.755758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.756082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.756616] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.756867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.758020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.758020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.758020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.758020] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.772118] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.772248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.772311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.772498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.772598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.772755] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.772843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.773128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.773128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.773128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.773329] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.773421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.773473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.773605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.773679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.773851] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.773936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.773984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.774133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.774204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.775602] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be created. [ 992.858471] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.858626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.858688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.858896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.860475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.869061] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 992.912306] env[63014]: INFO networking_nsxv3.common.synchronization [req-a565c4a7-e695-432a-b3a6-baf7e87f78e0 req-3802bff6-eed5-4f2b-a586-32d8609d78b6 tempest-ServerRescueNegativeTestJSON-1204428609 tempest-ServerRescueNegativeTestJSON-1204428609-project-member] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 992.912826] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 992.912826] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.912940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.912971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.913186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.913331] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.913468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.913522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.913802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.913922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.914027] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.954405] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.246893] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eea1ff77-b509-4f98-a878-bf09a64faa0e: rpc.has_security_group_logging(os_id): False [ 993.261280] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.261433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.261487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.261677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.261805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.261958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.262075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.262124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.262268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.262351] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.262426] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 already deleted. [ 993.262504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.263861] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-812 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.264155] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.264349] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.264580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.266039] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.266039] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.266039] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.266039] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.266039] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.266282] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.266282] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.266360] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.266479] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.266617] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 993.266709] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.266844] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.268452] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.268557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.268628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.268782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.268864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.269077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.269175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.269237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.269379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.269456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.269648] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.269743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.269802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.269939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.270015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.270193] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.270284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.270344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.270482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.270555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.270637] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 993.287296] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.287467] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 993.287606] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.287779] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.288088] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-cf547bd7-4dfb-4b5f-898f-b762033458f1 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.288263] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-cf547bd7-4dfb-4b5f-898f-b762033458f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.288543] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-cf547bd7-4dfb-4b5f-898f-b762033458f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.288856] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-cf547bd7-4dfb-4b5f-898f-b762033458f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.289009] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf547bd7-4dfb-4b5f-898f-b762033458f1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.330560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.330560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.330560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.330758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.330846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.342923] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 993.416711] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.456547] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.456703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.456778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.456977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.457087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.457200] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be created. [ 993.490256] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.490404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.490474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.490682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.490838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.499028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: UNINITIALIZED for 2s [ 993.791219] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.791525] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.791525] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.791859] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.791975] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.792597] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port cf547bd7-4dfb-4b5f-898f-b762033458f1 not found, creating... [ 993.792597] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.793399] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.793569] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.795233] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.795233] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.795233] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.795233] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.795233] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.795567] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.795766] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.795962] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: cf547bd7-4dfb-4b5f-898f-b762033458f1 is going to be created. [ 993.822228] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.822977] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.824409] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.824554] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.825093] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.825513] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-cf547bd7-4dfb-4b5f-898f-b762033458f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.919571] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.422768] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.423630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.423630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.423630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.423630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.423630] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc is going to be updated. [ 994.452931] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.453188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.453188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.453412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.453529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.461565] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: IN_PROGRESS for 2s [ 994.667262] env[63014]: INFO networking_nsxv3.common.synchronization [req-3f1a3c4d-1509-4c6e-bf0d-06127db6fedf req-9d23ea8e-2582-423a-8fc3-92ebe98e475e service nova] Enqueued Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_rules [ 994.667262] env[63014]: INFO networking_nsxv3.common.synchronization [req-3f1a3c4d-1509-4c6e-bf0d-06127db6fedf req-9d23ea8e-2582-423a-8fc3-92ebe98e475e service nova] Enqueued Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_members [ 994.667262] env[63014]: INFO networking_nsxv3.common.synchronization [req-3f1a3c4d-1509-4c6e-bf0d-06127db6fedf req-9d23ea8e-2582-423a-8fc3-92ebe98e475e service nova] Enqueued Resource ID: cf547bd7-4dfb-4b5f-898f-b762033458f1 with Priority: HIGHEST for action port [ 994.667262] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_rules [ 994.667262] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_members [ 994.667262] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf547bd7-4dfb-4b5f-898f-b762033458f1 with Priority: HIGHEST for action port [ 994.667262] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.667262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.667262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.668014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.668105] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.668961] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.669082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.669146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.669325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.669466] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.669557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.669615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.669767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.670040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.670040] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.671428] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf547bd7-4dfb-4b5f-898f-b762033458f1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.671428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf547bd7-4dfb-4b5f-898f-b762033458f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.671428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf547bd7-4dfb-4b5f-898f-b762033458f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.671428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf547bd7-4dfb-4b5f-898f-b762033458f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.671428] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf547bd7-4dfb-4b5f-898f-b762033458f1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.880322] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 994.880566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.173335] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.173335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.174080] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.174376] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf547bd7-4dfb-4b5f-898f-b762033458f1 with status ACTIVE [ 995.174570] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.174672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.174736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.175288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.175288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.175288] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.175468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.175468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.175628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.175699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.176215] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.177287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.177287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.177287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.177287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.177287] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf547bd7-4dfb-4b5f-898f-b762033458f1 is going to be updated. [ 995.198663] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.198663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.198663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.198663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.198663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.198663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf547bd7-4dfb-4b5f-898f-b762033458f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.359702] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 995.359915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.508827] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 995.508827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.508827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.508827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.509082] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.509082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.509082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.510451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.510451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.510451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.510451] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.680576] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.012509] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.012853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.012853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.012967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.013146] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.013247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.013313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.013464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.013555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.013645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.013797] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.013891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.013952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.014110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.014248] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.014338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.014400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.014539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.014615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.014695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.014782] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.182528] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.183261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.183261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.183428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.183512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.183620] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 is going to be created. [ 996.205352] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.205500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.205567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.205776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.205931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.214216] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 in Status: UNINITIALIZED for 2s [ 996.470833] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: SUCCESS [ 996.470979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.516736] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b49a7f5-6ed4-481f-81ba-d9ed36714c01: rpc.has_security_group_logging(os_id): False [ 996.533858] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.534041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.534114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.534429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.534429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.534619] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.534782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.534831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.535011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.535079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.535363] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.535473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.535529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.535722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.535764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.535910] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.535999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.536067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.536203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.536667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.536667] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be created. [ 996.587977] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.588121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.588165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.588373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.588780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.598949] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 998.226959] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 in Status: SUCCESS [ 998.227214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.227370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.227582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.227779] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.227888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.227953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.228136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.228228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.228281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.228411] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.586098] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.586329] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.586463] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.586744] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.587016] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.587181] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.587304] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.591017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.591017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.591017] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.591017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.591017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.591017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.591017] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 998.591017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.591017] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.609197] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.609390] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 998.609534] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.609706] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-729" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.610009] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-33bfc3ed-0b60-482a-9c61-857bb5452ee0 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.610210] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.610345] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.610595] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.610733] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33bfc3ed-0b60-482a-9c61-857bb5452ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.616484] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 998.616756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.730232] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.762380] env[63014]: INFO networking_nsxv3.common.synchronization [None req-90f15e29-bcd0-4375-a61c-6a1dc495f53c None None] Enqueued Resource ID: 76accca1-8297-439f-9dbe-f179d9e13bf5 with Priority: HIGHEST for action port [ 998.762641] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76accca1-8297-439f-9dbe-f179d9e13bf5 with Priority: HIGHEST for action port [ 998.762976] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-76accca1-8297-439f-9dbe-f179d9e13bf5 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.763112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76accca1-8297-439f-9dbe-f179d9e13bf5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.763731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76accca1-8297-439f-9dbe-f179d9e13bf5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.763731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76accca1-8297-439f-9dbe-f179d9e13bf5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.763731] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76accca1-8297-439f-9dbe-f179d9e13bf5',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.117206] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.117206] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.117206] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.117206] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.117206] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.117206] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.117206] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.117206] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.117206] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.117206] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.117622] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.117622] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.117622] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.117622] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.117622] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.117622] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 33bfc3ed-0b60-482a-9c61-857bb5452ee0 is going to be updated. [ 999.140174] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.140404] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.140526] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.140798] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.141010] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.141313] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.233059] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f61fdd6-c6dd-47e0-9456-36df63f208a2: rpc.has_security_group_logging(os_id): False [ 999.252197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.252420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.252420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.252626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.252722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.252978] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.253084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.253294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.253294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.253385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.253504] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 is going to be created. [ 999.268276] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76accca1-8297-439f-9dbe-f179d9e13bf5 [ 999.269136] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.269136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.269136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.269136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.269136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.269484] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76accca1-8297-439f-9dbe-f179d9e13bf5 already deleted. [ 999.269484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76accca1-8297-439f-9dbe-f179d9e13bf5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.329309] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.329594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.329594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.329761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.329952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.342574] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 in Status: IN_PROGRESS for 2s [ 999.938180] env[63014]: INFO networking_nsxv3.common.synchronization [req-b32d49b7-5cd3-4360-bb8f-1217ce32e1c3 req-757ed1be-9b1b-4055-8463-244a381c900c tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 999.938180] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 999.938180] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.938180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.938180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.938460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.938629] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.938713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.938757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.938913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.939398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.939398] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.037018] env[63014]: INFO networking_nsxv3.common.synchronization [req-17f2f716-2886-41d4-82a2-d00d789bc9de req-98f21eea-d478-4f1f-a696-0c3af06381d0 service nova] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_rules [ 1000.037018] env[63014]: INFO networking_nsxv3.common.synchronization [req-17f2f716-2886-41d4-82a2-d00d789bc9de req-98f21eea-d478-4f1f-a696-0c3af06381d0 service nova] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 1000.037018] env[63014]: INFO networking_nsxv3.common.synchronization [req-17f2f716-2886-41d4-82a2-d00d789bc9de req-98f21eea-d478-4f1f-a696-0c3af06381d0 service nova] Enqueued Resource ID: 33bfc3ed-0b60-482a-9c61-857bb5452ee0 with Priority: HIGHEST for action port [ 1000.037018] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_rules [ 1000.037018] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 1000.037018] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33bfc3ed-0b60-482a-9c61-857bb5452ee0 with Priority: HIGHEST for action port [ 1000.037018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.037018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.037018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.037954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.038126] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.039753] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.040133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.040301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.040569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.040794] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.040982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.041319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.041864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.042062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.042714] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.046077] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-33bfc3ed-0b60-482a-9c61-857bb5452ee0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.046077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.046077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.046077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.046077] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33bfc3ed-0b60-482a-9c61-857bb5452ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.441827] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.442241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.442241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.442357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.442437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.442694] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.442834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.442910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.443096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.443175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.443276] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1000.478781] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.478950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.479291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.479976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.480211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.491056] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1000.552242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.552242] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.552242] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33bfc3ed-0b60-482a-9c61-857bb5452ee0 with status ACTIVE [ 1000.552242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.552242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.552242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.552869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.553451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.553660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.553924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.554248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.554412] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33bfc3ed-0b60-482a-9c61-857bb5452ee0 is going to be updated. [ 1000.575671] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.576051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.576199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.576594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.576807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.577058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33bfc3ed-0b60-482a-9c61-857bb5452ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.935180] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ae6f8ad9-a3d9-400e-8317-11ca58be2b3d None None] Enqueued Resource ID: aee4d05b-cd88-4a3c-a335-f2d300d1ccde with Priority: HIGHEST for action port [ 1000.935508] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aee4d05b-cd88-4a3c-a335-f2d300d1ccde with Priority: HIGHEST for action port [ 1000.936123] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-aee4d05b-cd88-4a3c-a335-f2d300d1ccde taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.936250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aee4d05b-cd88-4a3c-a335-f2d300d1ccde" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.936334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aee4d05b-cd88-4a3c-a335-f2d300d1ccde" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.936617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aee4d05b-cd88-4a3c-a335-f2d300d1ccde" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.936697] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aee4d05b-cd88-4a3c-a335-f2d300d1ccde',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.056678] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.357468] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 in Status: SUCCESS [ 1001.357468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.438995] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aee4d05b-cd88-4a3c-a335-f2d300d1ccde [ 1001.440544] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.440544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.440544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.440544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.440544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.440544] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aee4d05b-cd88-4a3c-a335-f2d300d1ccde already deleted. [ 1001.440544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aee4d05b-cd88-4a3c-a335-f2d300d1ccde" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.559833] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.560231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.560231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.561364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.561364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.561364] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be updated. [ 1001.585815] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.585916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.585916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.586158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.586315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.597475] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 2s [ 1002.499756] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1002.499940] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 deletion is rescheduled due to dependency. [ 1002.500067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.606918] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 4s [ 1003.678066] env[63014]: INFO networking_nsxv3.common.synchronization [req-53711546-a7a6-483f-bc4e-c73ab8358d1f req-406d7b15-dbb6-4c8e-92d5-e3233f57592e tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1003.678687] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1003.678943] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.679534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.679534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.679534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.679834] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.679834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.679834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.680328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.680328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.680328] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.890856] env[63014]: INFO networking_nsxv3.common.synchronization [req-61ccabae-6900-40d0-a415-ff27af399f8e req-9d6c2b7c-3f7a-4415-82ca-08e737b8415a tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_members [ 1003.891416] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGHEST for action security_group_members [ 1003.891737] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.891907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.891958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.893530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.893719] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.893826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.893903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.895295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.895439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.895543] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.184154] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.184154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.184154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.184154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.184154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.184154] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.184154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.184154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.184154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.184154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.184154] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1004.211201] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.211377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.211477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.211700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.211861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.221256] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1004.401412] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.401412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.401412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.401412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.401412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.401412] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.401412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.401412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.401412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.401412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.401412] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb is going to be updated. [ 1004.429737] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.429737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.429737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.429737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.429737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.437071] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb in Status: IN_PROGRESS for 2s [ 1004.494342] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.494557] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.494762] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.495511] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.495742] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.496009] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.496327] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.496682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.497132] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.497420] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.497582] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.497785] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.497960] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.498140] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1004.498463] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.498523] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.517917] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.518155] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1004.518306] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.518485] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.518801] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-e89aa2c9-a241-4118-8281-e8f1ea156926 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.518974] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-e89aa2c9-a241-4118-8281-e8f1ea156926" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.519255] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-e89aa2c9-a241-4118-8281-e8f1ea156926" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.519439] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-e89aa2c9-a241-4118-8281-e8f1ea156926" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.519582] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e89aa2c9-a241-4118-8281-e8f1ea156926',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.588409] env[63014]: INFO networking_nsxv3.common.synchronization [req-f9d26748-13db-440c-8588-b200416d0368 req-054045e3-d371-4bf7-9276-e853f0d88049 tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1004.589357] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1004.589357] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.589357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.589512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.589627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.589765] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.589855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.589911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.590268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.590484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.590635] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.987809] env[63014]: INFO networking_nsxv3.common.synchronization [req-bfaace3e-9532-40ff-8eaa-6c1dd635a756 req-10b028f0-c14f-4986-9e18-953f84246752 tempest-AttachVolumeTestJSON-1387786992 tempest-AttachVolumeTestJSON-1387786992-project-member] Enqueued Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_members [ 1004.988309] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 with Priority: HIGHEST for action security_group_members [ 1004.988309] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-89a039f0-af50-4be6-96e7-c2a3698d5144 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.988309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.988426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.995317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.995544] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.995665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.995724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.995948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.996032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.996134] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89a039f0-af50-4be6-96e7-c2a3698d5144',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.022482] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.022689] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.022776] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.023173] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.023704] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.023704] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port e89aa2c9-a241-4118-8281-e8f1ea156926 not found, creating... [ 1005.024103] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.024103] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.024267] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.024693] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.024800] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.025383] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.025636] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.026076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.026076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.026524] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.026524] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: e89aa2c9-a241-4118-8281-e8f1ea156926 is going to be created. [ 1005.050954] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.051189] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.051321] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.051612] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.051856] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.052095] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-e89aa2c9-a241-4118-8281-e8f1ea156926" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.096186] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.096377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.096487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.096735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.096825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.097043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.097145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.097206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.097358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.097436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.097525] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1005.105938] env[63014]: INFO networking_nsxv3.common.synchronization [req-46e99b93-d269-48ba-99c8-bd95f163729d req-8b11b8d8-a2c6-46d7-8592-658454e11e39 tempest-ListServerFiltersTestJSON-1757136692 tempest-ListServerFiltersTestJSON-1757136692-project-member] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 1005.106487] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 1005.106844] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.106980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.107231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.108102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.108102] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.108102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.108102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.108102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.108102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.108406] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.138597] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.138768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.138861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.139127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.139265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.147954] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1005.499607] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.499848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.499958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.500253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.500396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.500682] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.500823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.500915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.501173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.501326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.501474] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 is going to be updated. [ 1005.530397] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.530613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.530658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.530925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.531198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.540293] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 in Status: IN_PROGRESS for 2s [ 1005.610318] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.615400] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 1005.615628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.617964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.617964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.617964] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.617964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.617964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.617964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.617964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.617964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.617964] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.773933] env[63014]: INFO networking_nsxv3.common.synchronization [req-53711546-a7a6-483f-bc4e-c73ab8358d1f req-160cb198-d51f-4072-b86a-f078dc05c5dd service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 1005.774400] env[63014]: INFO networking_nsxv3.common.synchronization [req-53711546-a7a6-483f-bc4e-c73ab8358d1f req-160cb198-d51f-4072-b86a-f078dc05c5dd service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1005.774400] env[63014]: INFO networking_nsxv3.common.synchronization [req-53711546-a7a6-483f-bc4e-c73ab8358d1f req-160cb198-d51f-4072-b86a-f078dc05c5dd service nova] Enqueued Resource ID: e89aa2c9-a241-4118-8281-e8f1ea156926 with Priority: HIGHEST for action port [ 1005.774596] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 1005.774663] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1005.774764] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e89aa2c9-a241-4118-8281-e8f1ea156926 with Priority: HIGHEST for action port [ 1005.775826] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.775949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.776015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.776219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.776300] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.777126] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.777224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.777414] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e89aa2c9-a241-4118-8281-e8f1ea156926 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.777514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e89aa2c9-a241-4118-8281-e8f1ea156926" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.777579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e89aa2c9-a241-4118-8281-e8f1ea156926" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.777745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e89aa2c9-a241-4118-8281-e8f1ea156926" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.777820] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e89aa2c9-a241-4118-8281-e8f1ea156926',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.112467] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.119326] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.119471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.119547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.119770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.119944] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.120404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.120404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.120404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.120404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.120557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.120885] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.121027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.121089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.121249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.121398] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.121496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.121582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.121793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.121888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.121978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.122189] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.231110] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1006.231110] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 1006.231110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.231295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.231440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.231623] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.231784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.231873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.232044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.232133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.232235] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.279199] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.279443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.279923] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e89aa2c9-a241-4118-8281-e8f1ea156926 with status ACTIVE [ 1006.279923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.279923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.279923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.280159] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.280203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.280502] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.280502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.280502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.280661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.280765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.280906] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.281037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.281092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.281227] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.281379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.281429] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e89aa2c9-a241-4118-8281-e8f1ea156926 is going to be updated. [ 1006.300418] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.300570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.300647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.300847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.300980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.301174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e89aa2c9-a241-4118-8281-e8f1ea156926" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.451626] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb in Status: SUCCESS [ 1006.451626] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb deletion is rescheduled due to dependency. [ 1006.451626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.614639] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.614868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.614972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.615234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.615423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.615625] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 1006.624891] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 549b1fb9-6c49-4106-8a22-052debb3b7f9: rpc.has_security_group_logging(os_id): False [ 1006.641565] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.641792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.641792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.642037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.642138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.642341] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.642458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.642545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.642722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.642809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.643029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.643129] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.643190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.643334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.643410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.643630] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.643768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.643810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.643980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.644068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.644156] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be updated. [ 1006.646938] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.647102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.647147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.647285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.647417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.658916] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 1006.715945] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.715945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.716225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.716272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.716463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.729746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 2s [ 1006.734183] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.158044] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1007.158370] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1007.158370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.237758] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.550988] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 in Status: SUCCESS [ 1007.550988] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89a039f0-af50-4be6-96e7-c2a3698d5144 deletion is rescheduled due to dependency. [ 1007.550988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89a039f0-af50-4be6-96e7-c2a3698d5144" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.742258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.742258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.742258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.742258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.742258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.742258] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1007.783628] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.783628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.783628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.783628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.783628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.793022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1008.069801] env[63014]: INFO networking_nsxv3.common.synchronization [req-d1bb013b-cdec-4444-b8c4-2a65b66dde16 req-256908ba-0724-4d1d-a143-d667731a1279 tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1008.070398] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1008.072342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.072342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.072342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.072342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.072342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.072342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.072342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.072342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.072342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.072342] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.428760] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.429121] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.429121] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.429383] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.429661] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.429815] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.429938] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.430180] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.430330] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.430585] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.430709] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.430830] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.430935] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.431063] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.431177] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.431316] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.448793] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.448970] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.449230] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.449363] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.449686] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-80cd32df-be4a-4d01-86f3-b1ee871902d4 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.449887] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-80cd32df-be4a-4d01-86f3-b1ee871902d4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.450028] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-80cd32df-be4a-4d01-86f3-b1ee871902d4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.450413] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-80cd32df-be4a-4d01-86f3-b1ee871902d4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.450575] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80cd32df-be4a-4d01-86f3-b1ee871902d4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.575052] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.671954] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 1008.672180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.741596] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 1008.741864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.952714] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.952900] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.953091] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.953358] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.953551] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.953708] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 80cd32df-be4a-4d01-86f3-b1ee871902d4 not found, creating... [ 1008.954066] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.954163] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.954280] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.954505] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.954649] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.954936] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.955110] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.955229] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.955647] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.955911] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.956086] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 80cd32df-be4a-4d01-86f3-b1ee871902d4 is going to be created. [ 1008.975641] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.975822] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.975946] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.976208] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.976451] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.977032] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-80cd32df-be4a-4d01-86f3-b1ee871902d4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.077255] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.582298] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.582609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.582609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.582846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.582964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.583110] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 1009.609425] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.609580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.609648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.610747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.610747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.618245] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1009.800341] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1009.800582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.800711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.800933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.801138] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.801251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.801318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.801472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.801555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.801641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.801736] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.858888] env[63014]: INFO networking_nsxv3.common.synchronization [req-d1bb013b-cdec-4444-b8c4-2a65b66dde16 req-71841ba4-b9cc-4027-839a-a9ea5247f05b service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 1009.859094] env[63014]: INFO networking_nsxv3.common.synchronization [req-d1bb013b-cdec-4444-b8c4-2a65b66dde16 req-71841ba4-b9cc-4027-839a-a9ea5247f05b service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1009.859240] env[63014]: INFO networking_nsxv3.common.synchronization [req-d1bb013b-cdec-4444-b8c4-2a65b66dde16 req-71841ba4-b9cc-4027-839a-a9ea5247f05b service nova] Enqueued Resource ID: 80cd32df-be4a-4d01-86f3-b1ee871902d4 with Priority: HIGHEST for action port [ 1009.859487] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 1009.859672] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1009.859741] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80cd32df-be4a-4d01-86f3-b1ee871902d4 with Priority: HIGHEST for action port [ 1009.860249] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.860376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.860446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.860651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.860733] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.861523] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.861621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.861809] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-80cd32df-be4a-4d01-86f3-b1ee871902d4 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.862371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80cd32df-be4a-4d01-86f3-b1ee871902d4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.862371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80cd32df-be4a-4d01-86f3-b1ee871902d4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.862371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80cd32df-be4a-4d01-86f3-b1ee871902d4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.862371] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80cd32df-be4a-4d01-86f3-b1ee871902d4',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.304196] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.304370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.304448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.305407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.305407] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.305407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.305407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.305407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.305407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.305407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.305715] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.305715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.305715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.305813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.305997] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.306109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.306254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.306340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.306415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.306501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.306695] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.367532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.367758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.367887] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 80cd32df-be4a-4d01-86f3-b1ee871902d4 with status ACTIVE [ 1010.368096] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.368200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.368304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.368745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.368745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.368843] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.368904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.368937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.369120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.369675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.369675] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.369675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.369675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.369675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.370106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.370106] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 80cd32df-be4a-4d01-86f3-b1ee871902d4 is going to be updated. [ 1010.394145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.394145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.394145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.394145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.394424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.394516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80cd32df-be4a-4d01-86f3-b1ee871902d4" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.810413] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b917177-fad2-4a8d-bb56-2b4d47acad21: rpc.has_security_group_logging(os_id): False [ 1010.828992] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.829662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.829901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.830248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.830501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.830871] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.831141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.831418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.832017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.832017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.836043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.836043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.836043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.836043] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1010.891134] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.891647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.891915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.892339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.892680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.910985] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1011.628313] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1011.629061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.629061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.629061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.629280] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.629280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.629371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.629544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.629625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.629719] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.132273] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.634172] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.927520] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1012.927520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.136955] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.137291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.137291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.137417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.137511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.137639] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 1013.164847] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.165012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.165058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.165291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.165506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.174249] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1014.861093] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1014.861093] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1015.190339] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1015.190339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.190555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.190796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.190986] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.191126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.191193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.191353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.191432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.191567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.191672] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.614278] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ffb1ac95-45a1-46d9-9c63-5f7600f17699 None None] Enqueued Resource ID: 77811efb-6b87-4f89-b688-6011dfed00ef with Priority: HIGHEST for action port [ 1015.614945] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77811efb-6b87-4f89-b688-6011dfed00ef with Priority: HIGHEST for action port [ 1015.615560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-77811efb-6b87-4f89-b688-6011dfed00ef taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.615675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77811efb-6b87-4f89-b688-6011dfed00ef" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.615727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77811efb-6b87-4f89-b688-6011dfed00ef" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.615990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77811efb-6b87-4f89-b688-6011dfed00ef" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.616073] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77811efb-6b87-4f89-b688-6011dfed00ef',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.695187] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.695340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.695455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.695701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.695863] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.696089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.696089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.696220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.696301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.696398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.696811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.696811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.696811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.697010] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.697123] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.697211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.697269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.697897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.697897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.697897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.697897] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.118991] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77811efb-6b87-4f89-b688-6011dfed00ef [ 1016.119341] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.119406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.119525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.119763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.119854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.119956] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77811efb-6b87-4f89-b688-6011dfed00ef already deleted. [ 1016.120052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77811efb-6b87-4f89-b688-6011dfed00ef" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.201940] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ee7fd9b-59b4-4423-847c-b926a3ab5883: rpc.has_security_group_logging(os_id): False [ 1016.221133] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.221133] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.221133] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.221133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.222126] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.222126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.222126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.224992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.224992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.224992] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 1016.281837] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.281837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.281837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.281837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.282323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.295845] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1017.122359] env[63014]: INFO networking_nsxv3.common.synchronization [req-9a4d4261-37fe-4ba7-9092-0f9c82d55d96 req-eae91981-de46-42a4-89d0-4a6dac522087 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 1017.122359] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 1017.122359] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.122359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.122359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.122359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.124217] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.124533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.124533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.125289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.125432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.125564] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.631952] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.632283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.632283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.632522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.648987] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.648987] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.648987] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.648987] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.650890] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.650890] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.651060] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.652116] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.652116] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.652116] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.652940] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.653618] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.653618] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.653618] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1017.653618] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.653783] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.655825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.655825] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.656175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.656175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.656239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.656272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.656465] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a is going to be updated. [ 1017.679834] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.680060] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1017.680240] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.680472] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.680851] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-7b7c2d7e-827f-4cf3-b653-f3584116886b taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.681072] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.681671] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.681671] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.681867] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b7c2d7e-827f-4cf3-b653-f3584116886b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.687057] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.687057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.687057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.687057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.687057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.702798] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: IN_PROGRESS for 2s [ 1018.186749] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.187060] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.187453] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.187453] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.187682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.188567] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 7b7c2d7e-827f-4cf3-b653-f3584116886b not found, creating... [ 1018.188954] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.189167] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.189297] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.189567] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.189991] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.190431] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.190735] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.190839] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.191138] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.191385] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.191802] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 7b7c2d7e-827f-4cf3-b653-f3584116886b is going to be created. [ 1018.211431] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.212197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.212197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.212465] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.213275] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.213900] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.320836] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1018.321458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.600804] env[63014]: INFO networking_nsxv3.common.synchronization [None req-3e94326b-535d-4821-96f8-f8f1b554a253 None None] Enqueued Resource ID: 045c19d8-3154-4103-a6a3-5da89afd962f with Priority: HIGHEST for action port [ 1018.600804] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 045c19d8-3154-4103-a6a3-5da89afd962f with Priority: HIGHEST for action port [ 1018.601387] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-045c19d8-3154-4103-a6a3-5da89afd962f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.601515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-045c19d8-3154-4103-a6a3-5da89afd962f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.601560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-045c19d8-3154-4103-a6a3-5da89afd962f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.601833] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-045c19d8-3154-4103-a6a3-5da89afd962f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.602324] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('045c19d8-3154-4103-a6a3-5da89afd962f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.103946] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 045c19d8-3154-4103-a6a3-5da89afd962f [ 1019.104267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.104418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.104490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.104719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.104814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.104937] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:045c19d8-3154-4103-a6a3-5da89afd962f already deleted. [ 1019.105111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-045c19d8-3154-4103-a6a3-5da89afd962f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.193352] env[63014]: INFO networking_nsxv3.common.synchronization [req-9a4d4261-37fe-4ba7-9092-0f9c82d55d96 req-e4e94ac4-008e-43f4-bf4f-b4ff8654bc49 service nova] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_rules [ 1019.193621] env[63014]: INFO networking_nsxv3.common.synchronization [req-9a4d4261-37fe-4ba7-9092-0f9c82d55d96 req-e4e94ac4-008e-43f4-bf4f-b4ff8654bc49 service nova] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 1019.193693] env[63014]: INFO networking_nsxv3.common.synchronization [req-9a4d4261-37fe-4ba7-9092-0f9c82d55d96 req-e4e94ac4-008e-43f4-bf4f-b4ff8654bc49 service nova] Enqueued Resource ID: 7b7c2d7e-827f-4cf3-b653-f3584116886b with Priority: HIGHEST for action port [ 1019.194297] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_rules [ 1019.194433] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 1019.194530] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7c2d7e-827f-4cf3-b653-f3584116886b with Priority: HIGHEST for action port [ 1019.194913] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.195053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.195154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.195460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.195460] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.196453] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.196509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.196714] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b7c2d7e-827f-4cf3-b653-f3584116886b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.196816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.197072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.197128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.197196] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b7c2d7e-827f-4cf3-b653-f3584116886b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.699509] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.699957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.700307] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b7c2d7e-827f-4cf3-b653-f3584116886b with status ACTIVE [ 1019.700628] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.701122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.701307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.701600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.701773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.702087] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.702322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.702462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.702719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.706187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.706187] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.706187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.706504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.709519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.709519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.709519] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b7c2d7e-827f-4cf3-b653-f3584116886b is going to be updated. [ 1019.721134] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: SUCCESS [ 1019.721321] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a deletion is rescheduled due to dependency. [ 1019.721431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.721603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.721894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.722103] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.722221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.722284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.722460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.722546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.722630] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.730145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.730145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.730145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.730145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.730145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.730145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.744302] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-3580fba7-6249-4a2a-90be-cdcb3ecbfd5e tempest-ListServersNegativeTestJSON-211585463 tempest-ListServersNegativeTestJSON-211585463-project-member] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1019.745413] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1019.745789] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.745915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.745978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.746274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.749021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.749021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.749021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.749021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.749021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.749021] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.760879] env[63014]: INFO networking_nsxv3.common.synchronization [req-98befcd8-bf2f-47f0-b4cf-bbaf6cbb870d req-d91d28ee-c6c9-41f7-a76f-4c91770d70a0 tempest-ServerRescueNegativeTestJSON-1204428609 tempest-ServerRescueNegativeTestJSON-1204428609-project-member] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 1019.761188] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGHEST for action security_group_members [ 1019.761519] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.762629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.762629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.762629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.763464] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.763620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.763694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.763894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.763985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.764099] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.113265] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-375 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.113582] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.113734] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.114180] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.114481] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.115468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.115617] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.115961] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.116167] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.116661] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.116661] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.116661] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.116800] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.116920] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1020.117098] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.117257] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.135109] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.135301] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1020.135516] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.135733] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.136090] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-797acca3-f743-47db-adcc-668de2c54253 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.136283] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-797acca3-f743-47db-adcc-668de2c54253" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.136409] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-797acca3-f743-47db-adcc-668de2c54253" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.136775] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-797acca3-f743-47db-adcc-668de2c54253" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.136899] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('797acca3-f743-47db-adcc-668de2c54253',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.225802] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.249217] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.249616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.249880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.250285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.251238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.251468] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.251598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.251765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.251824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.251888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.251983] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 already deleted. [ 1020.252457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.266384] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.266592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.266652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.266841] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.286302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.286677] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.286825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.286901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.287085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.287172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.287265] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc is going to be updated. [ 1020.310220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.310521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.310521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.310632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.310773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.321080] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: IN_PROGRESS for 2s [ 1020.639668] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.639966] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.640144] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.640517] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.640705] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.640874] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 797acca3-f743-47db-adcc-668de2c54253 not found, creating... [ 1020.641173] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.641402] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.641543] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.641783] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.641940] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.642310] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.642542] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.642688] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.642948] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.643142] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.643376] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 797acca3-f743-47db-adcc-668de2c54253 is going to be created. [ 1020.672771] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.672969] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.674804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.674804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.674804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.674804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-797acca3-f743-47db-adcc-668de2c54253" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.728476] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.231205] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.231599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.231599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.231724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.231819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.231921] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a is going to be updated. [ 1021.259088] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.259088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.259088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.259088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.259088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.267206] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: IN_PROGRESS for 2s [ 1021.395532] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-1695cd1c-da8b-4e77-b3d5-d9d0801a25f0 service nova] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_rules [ 1021.395532] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-1695cd1c-da8b-4e77-b3d5-d9d0801a25f0 service nova] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1021.396752] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-1695cd1c-da8b-4e77-b3d5-d9d0801a25f0 service nova] Enqueued Resource ID: 797acca3-f743-47db-adcc-668de2c54253 with Priority: HIGHEST for action port [ 1021.396752] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_rules [ 1021.397170] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1021.397248] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 797acca3-f743-47db-adcc-668de2c54253 with Priority: HIGHEST for action port [ 1021.398865] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.398865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.398865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.398865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.398865] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.399554] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.399554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.399554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.399554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.399554] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.399554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.399816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.400126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.400126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.400221] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.401332] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-797acca3-f743-47db-adcc-668de2c54253 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.401332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-797acca3-f743-47db-adcc-668de2c54253" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.401332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-797acca3-f743-47db-adcc-668de2c54253" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.401521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-797acca3-f743-47db-adcc-668de2c54253" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.401521] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('797acca3-f743-47db-adcc-668de2c54253',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.903662] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.905024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.905164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.905412] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 797acca3-f743-47db-adcc-668de2c54253 with status ACTIVE [ 1021.905634] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.905769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.905854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.906164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.906208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.906371] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.906470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.906534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.906717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.906801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.907008] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.907171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.907213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.907354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.907433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.907522] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 797acca3-f743-47db-adcc-668de2c54253 is going to be updated. [ 1021.927702] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.927787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.927875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.928010] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.928147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.928302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-797acca3-f743-47db-adcc-668de2c54253" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.286170] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-380aaaca-44a7-4300-86a5-b9315e8b7b9f tempest-ListServersNegativeTestJSON-211585463 tempest-ListServersNegativeTestJSON-211585463-project-member] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1022.286708] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1022.287030] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.287133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.327346] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc in Status: SUCCESS [ 1022.327560] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc deletion is rescheduled due to dependency. [ 1022.327698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.406322] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.757661] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-375 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.757920] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.758102] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.758413] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.758847] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.759155] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.760498] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.760498] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.760498] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.760498] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.760498] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.760700] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.760821] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.761108] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1022.762157] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.762157] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.785470] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.785681] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1022.785839] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.786058] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.786396] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-9c72949b-3167-4f8d-b939-cc23aa83395c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.786580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-9c72949b-3167-4f8d-b939-cc23aa83395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.786726] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-9c72949b-3167-4f8d-b939-cc23aa83395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.787093] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-9c72949b-3167-4f8d-b939-cc23aa83395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.787261] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c72949b-3167-4f8d-b939-cc23aa83395c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.911629] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.911795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.911883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.912135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.912227] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.912329] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be created. [ 1022.937889] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.938411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.938411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.938411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.938531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.948859] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: UNINITIALIZED for 2s [ 1023.277371] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: SUCCESS [ 1023.277768] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.277991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.278347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.278622] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.278755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.278859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.279098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.279193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.279277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.279423] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.292561] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.292842] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.292960] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.293320] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.293679] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.293679] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 9c72949b-3167-4f8d-b939-cc23aa83395c not found, creating... [ 1023.294018] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.294252] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.294386] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.294642] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.294865] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.295314] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.295592] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.295734] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.295982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.296153] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.296340] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 9c72949b-3167-4f8d-b939-cc23aa83395c is going to be created. [ 1023.314797] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.315057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.315189] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.315548] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.315831] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.316088] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-9c72949b-3167-4f8d-b939-cc23aa83395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.782133] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.782511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.782511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.782700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.782839] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.782960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.783028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.783164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.783239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.783811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.783811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.783811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.783811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.783811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.784157] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.784157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.784157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.784331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.784331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.784331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.784489] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.128553] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-aff2ee73-7e2d-4301-8669-a86c1dbb6e6b service nova] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_rules [ 1024.128553] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-aff2ee73-7e2d-4301-8669-a86c1dbb6e6b service nova] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1024.128553] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-aff2ee73-7e2d-4301-8669-a86c1dbb6e6b service nova] Enqueued Resource ID: 9c72949b-3167-4f8d-b939-cc23aa83395c with Priority: HIGHEST for action port [ 1024.128856] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_rules [ 1024.128856] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1024.128856] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c72949b-3167-4f8d-b939-cc23aa83395c with Priority: HIGHEST for action port [ 1024.129547] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.129722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.129967] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.130133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.130330] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c72949b-3167-4f8d-b939-cc23aa83395c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.130425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c72949b-3167-4f8d-b939-cc23aa83395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.130495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c72949b-3167-4f8d-b939-cc23aa83395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.131037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c72949b-3167-4f8d-b939-cc23aa83395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.131196] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c72949b-3167-4f8d-b939-cc23aa83395c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.287066] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a: rpc.has_security_group_logging(os_id): False [ 1024.304041] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.304041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.304041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.304041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.304459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.304459] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.304459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.304459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.304603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.304674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.304857] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.304949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.305018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.305161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.305236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.305414] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.305569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.305631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.305771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.305846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.306071] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a is going to be updated. [ 1024.359662] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.359808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.359862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.360176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.360339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.371017] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: IN_PROGRESS for 2s [ 1024.635819] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c72949b-3167-4f8d-b939-cc23aa83395c with status ACTIVE [ 1024.635819] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.635919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.635995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.636218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.636309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.636510] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.636604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.636729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.637052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.637052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.637184] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.637276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.637305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.637468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.637500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.637577] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c72949b-3167-4f8d-b939-cc23aa83395c is going to be updated. [ 1024.656192] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.656341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.656413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.656731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.656915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.657053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c72949b-3167-4f8d-b939-cc23aa83395c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.959916] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1024.960190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.960361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.960612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.960847] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.961013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.961086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.961282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.961385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.961480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.961584] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.966788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.966788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.966974] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.967103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.967168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.967559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.967666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.967769] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.023638] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-25fe3b86-c041-406f-98c4-4788562d4fac tempest-ListServersNegativeTestJSON-211585463 tempest-ListServersNegativeTestJSON-211585463-project-member] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1025.026593] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1025.026853] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.026956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.474154] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.474154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.474154] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.709047] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-375 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.709047] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.709047] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.709047] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.709265] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.709314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.709610] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.709816] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.709983] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.710228] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.710342] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.710452] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.710560] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.710671] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1025.710780] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.710915] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.729676] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.729994] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1025.730529] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.730529] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-375" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.730869] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-2c0a49f0-412a-43b9-98d5-563c83b063ed taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.731578] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-2c0a49f0-412a-43b9-98d5-563c83b063ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.731578] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-2c0a49f0-412a-43b9-98d5-563c83b063ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.731848] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-2c0a49f0-412a-43b9-98d5-563c83b063ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.731974] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c0a49f0-412a-43b9-98d5-563c83b063ed',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.976418] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.022500] env[63014]: INFO networking_nsxv3.common.synchronization [None req-6f042f26-10ea-4050-82a3-6fb3d05f1be1 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_rules [ 1026.022921] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_rules [ 1026.023528] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de490883-41da-4c7f-bed6-8ce11a434e5c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.023668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.023738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.023996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.024089] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.108334] env[63014]: INFO networking_nsxv3.common.synchronization [None req-153f74f6-1059-437c-b5d3-d304a90596c5 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_rules [ 1026.108959] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_rules [ 1026.109365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de490883-41da-4c7f-bed6-8ce11a434e5c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.109530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.235731] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.235731] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.235731] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.236104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.236605] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.236752] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 2c0a49f0-412a-43b9-98d5-563c83b063ed not found, creating... [ 1026.237332] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.237618] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.237845] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.238528] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.238871] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.239431] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.239753] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.239985] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.240379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.242528] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.242528] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 2c0a49f0-412a-43b9-98d5-563c83b063ed is going to be created. [ 1026.263162] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.263396] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.263558] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.263903] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.264106] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.264346] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-2c0a49f0-412a-43b9-98d5-563c83b063ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.387896] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: SUCCESS [ 1026.387896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.479648] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.480101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.480101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.480204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.480353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.480528] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1026.510114] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.510287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.510367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.510583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.510771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.523207] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1026.546222] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.546532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.546532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.546749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.546846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.546954] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de490883-41da-4c7f-bed6-8ce11a434e5c already deleted. [ 1026.547059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.547225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.547392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.547477] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.068380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.068567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.068567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.068748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.068844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.068943] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de490883-41da-4c7f-bed6-8ce11a434e5c already deleted. [ 1027.069038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.170414] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-ec93f811-7d07-4edd-84ab-20e31fea0163 service nova] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_rules [ 1027.170812] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-ec93f811-7d07-4edd-84ab-20e31fea0163 service nova] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1027.170812] env[63014]: INFO networking_nsxv3.common.synchronization [req-b092c6b7-136b-48b4-8f58-d80cdadbd85f req-ec93f811-7d07-4edd-84ab-20e31fea0163 service nova] Enqueued Resource ID: 2c0a49f0-412a-43b9-98d5-563c83b063ed with Priority: HIGHEST for action port [ 1027.171570] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_rules [ 1027.171763] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1027.171932] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c0a49f0-412a-43b9-98d5-563c83b063ed with Priority: HIGHEST for action port [ 1027.172270] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.172381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.172594] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.172695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.172943] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c0a49f0-412a-43b9-98d5-563c83b063ed taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.173968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c0a49f0-412a-43b9-98d5-563c83b063ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.173968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c0a49f0-412a-43b9-98d5-563c83b063ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.173968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c0a49f0-412a-43b9-98d5-563c83b063ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.173968] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c0a49f0-412a-43b9-98d5-563c83b063ed',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.370892] env[63014]: INFO networking_nsxv3.common.synchronization [req-dcea2b9c-6e1d-437e-b724-8630e65d28a1 req-fe5de5a1-e5ca-4747-b199-13f07e27fd7b tempest-ListServerFiltersTestJSON-1757136692 tempest-ListServerFiltersTestJSON-1757136692-project-member] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 1027.370892] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 1027.370892] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.370892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.370892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.370892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.372096] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.373283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.373283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.375164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.375164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.375164] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.486823] env[63014]: INFO networking_nsxv3.common.synchronization [req-4aa6216f-c7ad-42e0-acd8-64a8a1eeccae req-5a5f83f3-f0fc-4059-b0c8-996c56b48750 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1027.487534] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1027.487679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.487836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.487904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.489395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.489643] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.489818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.490051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.490191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.490884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.490884] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.638334] env[63014]: INFO networking_nsxv3.common.synchronization [req-1c7c9303-0213-444d-b79e-cfe2d6e5be70 req-c1006008-72c1-47ad-8339-d32bae5439bb tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1027.638838] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1027.639178] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.639609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.639609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.639609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.639797] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.639797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.639949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.639949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.640504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.640626] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.679511] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c0a49f0-412a-43b9-98d5-563c83b063ed with status ACTIVE [ 1027.679511] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.679511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.679511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.679511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.679511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.679785] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.679785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.679785] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.679897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.680097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.680167] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.680261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.680310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.680417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.680493] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.680569] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c0a49f0-412a-43b9-98d5-563c83b063ed is going to be updated. [ 1027.710990] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.711661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.712552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.712552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.712552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.712552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c0a49f0-412a-43b9-98d5-563c83b063ed" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.835854] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.835854] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.836023] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.836665] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.836665] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.837424] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.837424] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.837424] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.837424] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.837424] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.837781] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.837781] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.837781] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.837907] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1027.838103] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.838103] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.858317] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.858494] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1027.858633] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.858806] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.859186] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-c3e59fc5-a375-4a88-aa89-7184aa1870c2 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.859392] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-c3e59fc5-a375-4a88-aa89-7184aa1870c2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.859518] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-c3e59fc5-a375-4a88-aa89-7184aa1870c2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.859827] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-c3e59fc5-a375-4a88-aa89-7184aa1870c2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.860273] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3e59fc5-a375-4a88-aa89-7184aa1870c2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.879114] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.993948] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.993948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.993948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.993948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.994268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.994372] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.994531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.994701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.994894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.995082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.995831] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 already deleted. [ 1027.995831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.144094] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.363264] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.363520] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.366851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.366851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.366851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.366851] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port c3e59fc5-a375-4a88-aa89-7184aa1870c2 not found, creating... [ 1028.366851] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.366851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.366851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.366851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.366851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.366851] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.367684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.367684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.367684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.367684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.367684] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: c3e59fc5-a375-4a88-aa89-7184aa1870c2 is going to be created. [ 1028.381240] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.390805] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.390805] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.390805] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.390805] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.390805] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.390805] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-c3e59fc5-a375-4a88-aa89-7184aa1870c2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.539549] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1028.539549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.539960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.540660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.540660] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.540660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.540660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.540982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.540982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.541068] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.645432] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.886722] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.886867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.886968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.887187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.887298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.887398] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 1028.919317] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.919317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.919317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.919317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.919317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.925436] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 1029.043163] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.130866] env[63014]: INFO networking_nsxv3.common.synchronization [req-4aa6216f-c7ad-42e0-acd8-64a8a1eeccae req-dafeafd9-cebb-4880-82c3-01a82b87a4af service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1029.131596] env[63014]: INFO networking_nsxv3.common.synchronization [req-4aa6216f-c7ad-42e0-acd8-64a8a1eeccae req-dafeafd9-cebb-4880-82c3-01a82b87a4af service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1029.131908] env[63014]: INFO networking_nsxv3.common.synchronization [req-4aa6216f-c7ad-42e0-acd8-64a8a1eeccae req-dafeafd9-cebb-4880-82c3-01a82b87a4af service nova] Enqueued Resource ID: c3e59fc5-a375-4a88-aa89-7184aa1870c2 with Priority: HIGHEST for action port [ 1029.132649] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1029.132869] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1029.133076] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3e59fc5-a375-4a88-aa89-7184aa1870c2 with Priority: HIGHEST for action port [ 1029.136060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.136060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.136060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.136060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.136060] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.136060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.136060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.136060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.136060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.136060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.136519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.136519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.136666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.136862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.137075] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.138305] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3e59fc5-a375-4a88-aa89-7184aa1870c2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.138305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3e59fc5-a375-4a88-aa89-7184aa1870c2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.138453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3e59fc5-a375-4a88-aa89-7184aa1870c2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.138695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3e59fc5-a375-4a88-aa89-7184aa1870c2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.138818] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3e59fc5-a375-4a88-aa89-7184aa1870c2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.147855] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.148039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.148114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.148422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.148583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.148746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 1029.177702] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.177882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.177975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.178241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.178389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.188119] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1029.546277] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.645767] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.645767] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.645767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.646678] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3e59fc5-a375-4a88-aa89-7184aa1870c2 with status ACTIVE [ 1029.646678] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.646678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.646678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.646943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.646943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.648296] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.648296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.648296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.648296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.648296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.648296] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.648296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.648296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.648296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.648296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.648296] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3e59fc5-a375-4a88-aa89-7184aa1870c2 is going to be updated. [ 1029.677592] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.677856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.678144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.678239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.678412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.678791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3e59fc5-a375-4a88-aa89-7184aa1870c2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.794749] env[63014]: INFO networking_nsxv3.common.synchronization [req-17d9d573-a7d6-4dda-88e8-792e1fcad040 req-e4c11038-84bd-4f2a-b9cd-fa11ec15a5d9 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 1029.795344] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGHEST for action security_group_members [ 1029.795739] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.795874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.795933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.796135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.796442] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.796603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.796832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.796832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.797033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.797033] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.886373] env[63014]: INFO networking_nsxv3.common.synchronization [req-17d9d573-a7d6-4dda-88e8-792e1fcad040 req-e4c11038-84bd-4f2a-b9cd-fa11ec15a5d9 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 7b7c2d7e-827f-4cf3-b653-f3584116886b with Priority: HIGHEST for action port [ 1029.886940] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b7c2d7e-827f-4cf3-b653-f3584116886b with Priority: HIGHEST for action port [ 1029.887336] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b7c2d7e-827f-4cf3-b653-f3584116886b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.887481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.887550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.887817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.887891] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b7c2d7e-827f-4cf3-b653-f3584116886b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.051348] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.051348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.051348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.051348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.051348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.051348] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1030.075412] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.075649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.076262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.076511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.076730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.092032] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1030.147088] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.298678] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.299124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.299247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.299462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.299555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.299774] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.299884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.300747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.300747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.300747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.300747] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a is going to be updated. [ 1030.329574] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.330259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.330371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.330616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.330793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.343032] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: IN_PROGRESS for 2s [ 1030.393257] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b7c2d7e-827f-4cf3-b653-f3584116886b with status ACTIVE [ 1030.393528] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.393677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.393881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.394198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.394297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.394497] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.394598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.394658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.395032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.395115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.395409] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.395525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.395622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.395771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.395850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.396508] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b7c2d7e-827f-4cf3-b653-f3584116886b is going to be updated. [ 1030.417395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.417569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.417614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.417831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.417981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.418155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b7c2d7e-827f-4cf3-b653-f3584116886b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.654380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.654633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.654633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.654806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.654897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.654997] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be created. [ 1030.697615] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.697757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.697826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.698048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.698211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.711624] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: UNINITIALIZED for 2s [ 1030.935141] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 1030.935381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.200862] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1031.201095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.100140] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1032.100458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.100581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.100786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.100969] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.101099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.101165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.101342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.101429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.101535] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.351639] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a in Status: SUCCESS [ 1032.351639] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a deletion is rescheduled due to dependency. [ 1032.351639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.604123] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.729654] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1032.729934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.730142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.730655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.730854] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.730971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.731048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.731219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.731303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.731389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.731477] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.106989] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.233853] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.233946] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.234021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.234196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.234364] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.234465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.234526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.234670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.234753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.234836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.234973] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.235072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.235129] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.235308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.235639] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.235639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.235782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.236202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.236335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.236449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.236636] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.610440] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.610440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.610440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.610440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.610440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.610440] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1033.643078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.643281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.643343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.643676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.643896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.656740] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1033.740492] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c29d6f-7489-45e1-8183-08f2d7095d33: rpc.has_security_group_logging(os_id): False [ 1033.759639] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.759933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.760050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.760291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.760410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.760623] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.760775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.760824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.760996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.761112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.761320] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.761453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.761535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.761713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.761825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.762076] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.762208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.762289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.762455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.762556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.762673] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be created. [ 1033.855033] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.855259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.855336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.855649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.855865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.866042] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1034.888990] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1034.888990] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 1035.389262] env[63014]: INFO networking_nsxv3.common.synchronization [req-c7ad6236-9eac-4b6c-bd54-f469632434bb req-6f550be7-f9ca-4eb4-ab2a-02e304a984e3 tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1035.389910] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1035.391066] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.391279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.391279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.391466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.391640] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.392214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.392214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.392214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.392214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.392214] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.665827] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1035.666105] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.666318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.666809] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.667083] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.667260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.667329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.667498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.667594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.667680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.667855] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.667938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.668013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.672263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.672530] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.672661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.672747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.672936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.673721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.673721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.673721] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.674278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.674472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.675173] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.675173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.675173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.675173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.675564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.675657] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.715200] env[63014]: INFO networking_nsxv3.common.synchronization [req-0d29d322-acc1-4006-ba25-cd1078f51924 req-87fbbae9-38da-437b-a602-8c26f56855f2 tempest-ServersNegativeTestJSON-729475527 tempest-ServersNegativeTestJSON-729475527-project-member] Enqueued Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 1035.715950] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 with Priority: HIGHEST for action security_group_members [ 1035.718887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-549b1fb9-6c49-4106-8a22-052debb3b7f9 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.719103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.719252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.719596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.719852] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.720019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.720156] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.720461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.720617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.720985] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('549b1fb9-6c49-4106-8a22-052debb3b7f9',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.878463] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1035.878708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.898843] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.899318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.899318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.899448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.899448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.899646] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.899751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.899801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.899992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.900096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.900192] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1035.925344] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.925612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.925776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.925902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.926097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.939594] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1036.079333] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.079603] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.079754] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.080119] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.080433] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.080610] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.080763] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.081146] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.081496] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.081868] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.081868] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.083260] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.083437] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.083779] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1036.084024] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.084139] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.102483] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.102679] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1036.102826] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.103634] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.103634] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-5a16f116-70d9-48f6-98ab-5e48a44ae07a taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.103634] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-5a16f116-70d9-48f6-98ab-5e48a44ae07a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.103968] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-5a16f116-70d9-48f6-98ab-5e48a44ae07a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.104101] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-5a16f116-70d9-48f6-98ab-5e48a44ae07a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.104249] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a16f116-70d9-48f6-98ab-5e48a44ae07a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.179869] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.181455] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8019faa-8b2f-47fe-bceb-e7ffa5b64330: rpc.has_security_group_logging(os_id): False [ 1036.200553] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.200755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.200830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.201130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.201220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.201453] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.201564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.201795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.201861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.201892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.202110] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.202224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.202288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.202454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.202532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.202741] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.202838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.202904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.203099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.203194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.203288] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be created. [ 1036.226518] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.226518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.226518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.226825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.226944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.227268] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.227411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.227475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.227710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.227803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.227920] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 is going to be updated. [ 1036.255833] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.256030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.256078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.256327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.257061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.259233] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.259374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.261189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.261189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.261189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.269853] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: IN_PROGRESS for 2s [ 1036.271445] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1036.611030] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.611030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.611030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.611030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.611030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.611030] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 5a16f116-70d9-48f6-98ab-5e48a44ae07a not found, creating... [ 1036.611030] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.611030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.612100] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.612586] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.612926] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.613482] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.613978] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.614252] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.614629] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.614940] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.615244] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 5a16f116-70d9-48f6-98ab-5e48a44ae07a is going to be created. [ 1036.640159] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.640443] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.640528] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.640793] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.641078] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.641361] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-5a16f116-70d9-48f6-98ab-5e48a44ae07a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.684221] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.190346] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.190830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.190830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.191203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.191203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.191203] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1037.222085] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.222258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.222298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.222525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.222701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.233096] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1037.953415] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1037.953642] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1037.953831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.021813] env[63014]: INFO networking_nsxv3.common.synchronization [req-c7ad6236-9eac-4b6c-bd54-f469632434bb req-d98ea9b5-cf14-4efb-87f0-3a31256ee3d7 service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1038.021994] env[63014]: INFO networking_nsxv3.common.synchronization [req-c7ad6236-9eac-4b6c-bd54-f469632434bb req-d98ea9b5-cf14-4efb-87f0-3a31256ee3d7 service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1038.022163] env[63014]: INFO networking_nsxv3.common.synchronization [req-c7ad6236-9eac-4b6c-bd54-f469632434bb req-d98ea9b5-cf14-4efb-87f0-3a31256ee3d7 service nova] Enqueued Resource ID: 5a16f116-70d9-48f6-98ab-5e48a44ae07a with Priority: HIGHEST for action port [ 1038.022418] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1038.022551] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1038.022647] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a16f116-70d9-48f6-98ab-5e48a44ae07a with Priority: HIGHEST for action port [ 1038.023635] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.023749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.023817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.024044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.024124] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.025948] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.026082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.026150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.026333] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.026482] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.026582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.026645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.026794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.026881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.026972] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.027753] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a16f116-70d9-48f6-98ab-5e48a44ae07a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.030061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a16f116-70d9-48f6-98ab-5e48a44ae07a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.030061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a16f116-70d9-48f6-98ab-5e48a44ae07a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.030151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a16f116-70d9-48f6-98ab-5e48a44ae07a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.030231] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a16f116-70d9-48f6-98ab-5e48a44ae07a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.280482] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 in Status: SUCCESS [ 1038.280760] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 549b1fb9-6c49-4106-8a22-052debb3b7f9 deletion is rescheduled due to dependency. [ 1038.280872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-549b1fb9-6c49-4106-8a22-052debb3b7f9" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.282324] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1038.282554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.282838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.283732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.283835] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.526967] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.527170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.531582] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.533241] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a16f116-70d9-48f6-98ab-5e48a44ae07a with status ACTIVE [ 1038.533523] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.533774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.533810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.534056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.534167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.534365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.534465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.534522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.534690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.534776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.535034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.535084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.535152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.535329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.535329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.535432] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a16f116-70d9-48f6-98ab-5e48a44ae07a is going to be updated. [ 1038.557353] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.557497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.557497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.557739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.557858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.558035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a16f116-70d9-48f6-98ab-5e48a44ae07a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.786311] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.786594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.033821] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.244548] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1039.244833] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.245164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.245340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.245588] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.245713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.245780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.245954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.246043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.246129] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.246218] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.394030] env[63014]: INFO networking_nsxv3.common.synchronization [req-14f1364d-fd97-4da7-8712-9e8b31dcb3a2 req-0f4d49ca-35bd-4a17-be7c-d469be16ff71 tempest-ListServersNegativeTestJSON-211585463 tempest-ListServersNegativeTestJSON-211585463-project-member] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1039.394030] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1039.394030] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.394730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.394917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.396079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.396079] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.396079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.396079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.396079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.396297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.396297] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.537342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.538219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.538219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.538219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.538219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.538219] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1039.564228] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.564380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.564439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.566507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.566507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.575063] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1039.749079] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.749317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.898613] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.401314] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.463063] env[63014]: INFO networking_nsxv3.common.synchronization [req-cc48d7c1-1019-4dcf-9baa-76e4da6a28e3 req-e02e679a-ae30-41e9-a901-4b9bbe7e11d8 tempest-ListServerFiltersTestJSON-1757136692 tempest-ListServerFiltersTestJSON-1757136692-project-member] Enqueued Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 1040.463610] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eea1ff77-b509-4f98-a878-bf09a64faa0e with Priority: HIGHEST for action security_group_members [ 1040.464840] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-eea1ff77-b509-4f98-a878-bf09a64faa0e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.465112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.465220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.465684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.466095] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.467256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.467334] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.468417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.468602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.469611] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eea1ff77-b509-4f98-a878-bf09a64faa0e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.903989] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.905429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.905429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.905429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.905429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.905429] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1040.934178] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.934384] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.934470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.934719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.934895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.943220] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1040.975545] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.975776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.975851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.976069] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.976167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.976390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.976509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.976597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.976773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.976846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.976941] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e is going to be updated. [ 1041.002593] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.002873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.002873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.003516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.003516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.012931] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: IN_PROGRESS for 2s [ 1041.587521] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1041.587831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.587941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.588190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.588398] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.588528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.588600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.588780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.588847] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.588936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.589049] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.729927] env[63014]: INFO networking_nsxv3.common.synchronization [req-8b5e0f76-b694-420b-9622-072c70938399 req-ae6cdb49-15a4-4f18-8c07-ca18843f61ba tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1041.731056] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1041.732924] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.735281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.735369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.735589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.735768] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.735876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.735941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.736119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.736199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.736297] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.809288] env[63014]: INFO networking_nsxv3.common.synchronization [req-592661dc-3b51-4e68-bdbb-ec8488be573d req-7963f5e8-69f4-4a91-a19f-6ce1d26b3784 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_members [ 1041.809288] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_members [ 1041.809512] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-de490883-41da-4c7f-bed6-8ce11a434e5c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.809586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.809586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.810204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.810399] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.810510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.810571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.810820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.810912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.811018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.094720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.094720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.094720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.094720] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.094720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.095585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.095585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.095585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.095585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.095585] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.241860] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.241860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.241860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.241860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.241860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.241860] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.241860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.241860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.241860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.242431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.242609] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 1042.271187] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.272272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.272272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.272272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.272272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.283894] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1042.308053] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.308304] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.308434] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.308709] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.308998] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.311435] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.311580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.311923] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.312143] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.312836] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.312836] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.312836] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.312836] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.313033] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1042.313148] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.313354] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.315610] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.315752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.315820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.316089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.316180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.316371] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.316486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.316538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.316703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.316784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.316881] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de490883-41da-4c7f-bed6-8ce11a434e5c already deleted. [ 1042.316950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.338565] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.338768] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1042.338876] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.339068] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.339410] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-96a54a0c-1394-4845-9cbf-435d2260340f taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.339592] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-96a54a0c-1394-4845-9cbf-435d2260340f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.339720] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-96a54a0c-1394-4845-9cbf-435d2260340f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.340135] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-96a54a0c-1394-4845-9cbf-435d2260340f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.340287] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a54a0c-1394-4845-9cbf-435d2260340f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.601418] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b49a7f5-6ed4-481f-81ba-d9ed36714c01: rpc.has_security_group_logging(os_id): False [ 1042.618655] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.619060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.619060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.619181] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.619215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.619428] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.619660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.619660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.619747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.619797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.620072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.620158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.620158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.620288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.620362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.620535] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.620628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.620700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.620867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.620915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.620982] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1042.696179] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.696355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.696415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.696764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.696834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.709979] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1042.847880] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.847880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.847880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.847880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.847880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.847880] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 96a54a0c-1394-4845-9cbf-435d2260340f not found, creating... [ 1042.847880] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.847880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.847880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.848458] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.848458] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.848458] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.848717] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.851027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.851027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.851027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.851027] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 96a54a0c-1394-4845-9cbf-435d2260340f is going to be created. [ 1042.869965] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.870239] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.870369] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.870641] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.870869] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.871116] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-96a54a0c-1394-4845-9cbf-435d2260340f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.957285] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1042.957523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.957704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.957925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.958143] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.958262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.958328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.958482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.958563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.958654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.958806] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.958900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.958959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.959124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.959262] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.959355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.959966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.959966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.959966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.960579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.960762] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.032411] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eea1ff77-b509-4f98-a878-bf09a64faa0e in Status: SUCCESS [ 1043.032411] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eea1ff77-b509-4f98-a878-bf09a64faa0e deletion is rescheduled due to dependency. [ 1043.032411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eea1ff77-b509-4f98-a878-bf09a64faa0e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.462860] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8019faa-8b2f-47fe-bceb-e7ffa5b64330: rpc.has_security_group_logging(os_id): False [ 1043.480098] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.480369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.480479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.480823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.480985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.481312] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.481506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.481612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.481995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.482090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.482355] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.482507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.482638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.482898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.483039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.483397] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.483571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.483666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.483910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.484059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.484199] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1043.545825] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.545825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.545825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.545825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.545825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.561534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1043.583158] env[63014]: INFO networking_nsxv3.common.synchronization [req-592661dc-3b51-4e68-bdbb-ec8488be573d req-4f158518-3147-4fe2-881c-b5acb20edad9 service nova] Enqueued Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_rules [ 1043.583374] env[63014]: INFO networking_nsxv3.common.synchronization [req-592661dc-3b51-4e68-bdbb-ec8488be573d req-4f158518-3147-4fe2-881c-b5acb20edad9 service nova] Enqueued Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_members [ 1043.583665] env[63014]: INFO networking_nsxv3.common.synchronization [req-592661dc-3b51-4e68-bdbb-ec8488be573d req-4f158518-3147-4fe2-881c-b5acb20edad9 service nova] Enqueued Resource ID: 96a54a0c-1394-4845-9cbf-435d2260340f with Priority: HIGHEST for action port [ 1043.583723] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_rules [ 1043.583857] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_members [ 1043.583943] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a54a0c-1394-4845-9cbf-435d2260340f with Priority: HIGHEST for action port [ 1043.584512] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de490883-41da-4c7f-bed6-8ce11a434e5c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.584640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.584729] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.584906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.584983] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.586473] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-de490883-41da-4c7f-bed6-8ce11a434e5c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.586830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.586966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.587167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.587780] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.587780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.587780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.587924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.588065] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.588701] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.591537] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-96a54a0c-1394-4845-9cbf-435d2260340f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.591537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96a54a0c-1394-4845-9cbf-435d2260340f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.591537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96a54a0c-1394-4845-9cbf-435d2260340f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.591537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96a54a0c-1394-4845-9cbf-435d2260340f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.591537] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a54a0c-1394-4845-9cbf-435d2260340f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.087654] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-de490883-41da-4c7f-bed6-8ce11a434e5c taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.088076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.090208] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.092422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96a54a0c-1394-4845-9cbf-435d2260340f with status ACTIVE [ 1044.092679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.092843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.092941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.093201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.093333] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.093578] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.093697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.093764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.093929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.094063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.094284] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.094422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.094612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.094793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.094903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.095028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96a54a0c-1394-4845-9cbf-435d2260340f is going to be updated. [ 1044.121869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.122027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.122099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.122299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.122432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.122593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96a54a0c-1394-4845-9cbf-435d2260340f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.294946] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1044.295202] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 deletion is rescheduled due to dependency. [ 1044.295340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.593528] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.729674] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1044.729944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.097652] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.097652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.098664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.098664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.098664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.098664] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de490883-41da-4c7f-bed6-8ce11a434e5c is going to be created. [ 1045.123710] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.123934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.123934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.124959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.124959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.136290] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de490883-41da-4c7f-bed6-8ce11a434e5c in Status: UNINITIALIZED for 2s [ 1045.575140] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1045.579109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.579109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.579109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.579109] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.080635] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.080792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.080858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.081113] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.081293] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.081398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.081462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.081619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.081711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.081800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.081892] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.585219] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.585219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.585219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.585663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.585663] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.585741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.585803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.585952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.586049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.586140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.586283] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.586375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.586435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.586603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.586786] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.586890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.586953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.587117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.587191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.587278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.587561] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.089340] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8019faa-8b2f-47fe-bceb-e7ffa5b64330: rpc.has_security_group_logging(os_id): False [ 1047.117241] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.117241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.117641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.117801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.117801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.117987] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.118095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.118149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.118306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.118386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.118580] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.118676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.118727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.118866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.118938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.119159] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.119245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.119302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.119470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.119596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.119724] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1047.146519] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de490883-41da-4c7f-bed6-8ce11a434e5c in Status: SUCCESS [ 1047.146519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.146985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.146985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.147241] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.147241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.147241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.147434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.147612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.147612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.147728] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.203632] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.203792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.203856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.204143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.204352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.221087] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1047.649529] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.154368] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de490883-41da-4c7f-bed6-8ce11a434e5c: rpc.has_security_group_logging(os_id): False [ 1048.171685] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.172042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.172201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.174108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.174108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.174108] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.174108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.174108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.174108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.174108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.174108] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de490883-41da-4c7f-bed6-8ce11a434e5c is going to be created. [ 1048.228875] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.229024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.229099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.229404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.229495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.239984] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de490883-41da-4c7f-bed6-8ce11a434e5c in Status: IN_PROGRESS for 2s [ 1048.370679] env[63014]: INFO networking_nsxv3.common.synchronization [req-a14f42d7-93cc-41e8-8a4b-912decc27c32 req-44a2a9d4-5bba-4a4d-9dfb-bcce15ab3202 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1048.370679] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1048.370679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.370679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.370679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.370679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.370679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.370679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.370679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.370679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.370679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.370679] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.698272] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.698590] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.698590] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.698883] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.699203] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.699335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.699453] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.699677] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.699824] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.700041] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1048.700326] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.700326] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.700417] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.700486] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1048.700597] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.700739] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.722547] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.722720] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1048.722860] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.723044] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.723359] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-8bb3c846-442f-4735-9609-76e15c394e9d taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.723530] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-8bb3c846-442f-4735-9609-76e15c394e9d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.723653] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-8bb3c846-442f-4735-9609-76e15c394e9d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.723974] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-8bb3c846-442f-4735-9609-76e15c394e9d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.724135] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb3c846-442f-4735-9609-76e15c394e9d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.871019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.226340] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.226610] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.226765] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.227063] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.227221] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.227383] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 8bb3c846-442f-4735-9609-76e15c394e9d not found, creating... [ 1049.227758] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.227970] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.228172] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.228448] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.228764] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.229225] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.229392] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.229524] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.229764] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.229912] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.230083] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 8bb3c846-442f-4735-9609-76e15c394e9d is going to be created. [ 1049.238730] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1049.238957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.250941] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.251209] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.251385] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.251687] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.251937] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.252207] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-8bb3c846-442f-4735-9609-76e15c394e9d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.373108] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.720021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.720471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.720471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.720471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.720628] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.875976] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.875976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.875976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.877365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.877365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.877365] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1049.907994] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.908211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.908257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.908453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.908597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.917459] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1050.019404] env[63014]: INFO networking_nsxv3.common.synchronization [req-a14f42d7-93cc-41e8-8a4b-912decc27c32 req-5b30f6dd-9f04-4320-baae-9868e4e9fff6 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1050.019597] env[63014]: INFO networking_nsxv3.common.synchronization [req-a14f42d7-93cc-41e8-8a4b-912decc27c32 req-5b30f6dd-9f04-4320-baae-9868e4e9fff6 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1050.019743] env[63014]: INFO networking_nsxv3.common.synchronization [req-a14f42d7-93cc-41e8-8a4b-912decc27c32 req-5b30f6dd-9f04-4320-baae-9868e4e9fff6 service nova] Enqueued Resource ID: 8bb3c846-442f-4735-9609-76e15c394e9d with Priority: HIGHEST for action port [ 1050.020104] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1050.020104] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1050.020207] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bb3c846-442f-4735-9609-76e15c394e9d with Priority: HIGHEST for action port [ 1050.020736] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.020908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.020991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.021238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.021322] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.022129] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.022223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.022415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bb3c846-442f-4735-9609-76e15c394e9d taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.022513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bb3c846-442f-4735-9609-76e15c394e9d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.022577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bb3c846-442f-4735-9609-76e15c394e9d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.022750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bb3c846-442f-4735-9609-76e15c394e9d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.022823] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bb3c846-442f-4735-9609-76e15c394e9d',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.223180] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.250852] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de490883-41da-4c7f-bed6-8ce11a434e5c in Status: SUCCESS [ 1050.251122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.524774] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.524952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.525183] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8bb3c846-442f-4735-9609-76e15c394e9d with status ACTIVE [ 1050.525399] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.525534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.525625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.525919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.526066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.526310] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.526433] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.526515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.526745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.526821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.527089] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.527214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.527297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.527875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.527875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.527875] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8bb3c846-442f-4735-9609-76e15c394e9d is going to be updated. [ 1050.551425] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.551638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.551721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.551982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.552179] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.552376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bb3c846-442f-4735-9609-76e15c394e9d" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.725329] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.228566] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1051.228726] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1051.927773] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1051.928131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.928339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.928751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.928976] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.929133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.929195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.929395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.929486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.929586] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.106608] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.106917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.107083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.107402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.124764] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1052.125898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.127047] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1052.165179] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.165388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.165462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.165718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.179445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.180337] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1052.180484] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.180792] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1052.227370] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.227519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.227585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.227781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.229933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.229933] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1052.304665] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.304906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.304906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.305093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.305423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.305788] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1052.398895] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.399096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.399181] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.399438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.399782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.400182] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:52. [ 1052.400423] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'83b49506-3ed3-4eac-ace0-a5b2e6ee77b0', '010d89fa-3730-42a5-9a3c-78c8b3dd3fbb', '5b44cf44-3516-4644-9659-498297843d9a', '4ee7fd9b-59b4-4423-847c-b926a3ab5883', 'b799ddde-e254-4e10-850e-ade205a5fd9b', '5d7ee0cf-ae1b-49b2-a857-8517362a3d5e', '546a1fbc-63de-4ead-af89-1f218af29386', '2b5e3c0e-e904-4e19-9ad4-9885064b94bb', 'db110989-027c-4ed8-b5db-6b256912c344', 'b31bea8a-6eb8-474e-9f80-c659e23a5477', 'd19bea52-b73c-4d06-87a2-c45103884998', '294457ec-0617-4c91-a38e-e6195397f5a3', 'b654582e-9aa5-4cb5-919f-974e7b4e9f66', '58b78822-d387-4773-a568-316aa746de6a', 'd8019faa-8b2f-47fe-bceb-e7ffa5b64330', 'e50835d8-af5a-48b2-b8ae-a4f696900f48', '6f61fdd6-c6dd-47e0-9456-36df63f208a2', 'd3082e67-cc51-4dbb-a0f9-69738e0314d0', '864e57d5-1404-49e7-b86e-6aa5865742d0', '8a204f6f-e771-4e85-aa7c-c93c90225b83', '1c9b8f59-0fe1-4382-ad8c-018641195651', '3ee9bfb9-a909-4897-ba13-1c6476ab4ce8', '619cffb4-27cb-425f-bcd2-3f3b163886dc', '7b79f694-9d2b-4c43-8cea-cdc6e6ac940a', '0a07f521-fa55-49eb-99e1-95d44b468907', 'de490883-41da-4c7f-bed6-8ce11a434e5c', '5ab69c49-5404-4dd4-a6d3-4fce8969088a', 'dcaf011c-cc1f-4e0b-b169-b433df9cce25', '8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08', '6b917177-fad2-4a8d-bb56-2b4d47acad21', '9b49a7f5-6ed4-481f-81ba-d9ed36714c01', '4cb735ae-137c-4021-8f15-a132e8df5b1b', '552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b', '98c66d04-d431-433a-9b0a-4fec6e74caca', '8c3c5e73-32ea-4e2f-aecf-a8278a3549df', 'eea1ff77-b509-4f98-a878-bf09a64faa0e', '67b29187-e991-47a0-93b3-5a8f6f288242', '24d80c6b-3ebf-4ee6-8524-63b081da521b', '9141a736-220e-4a6b-b407-916c87c8099c', '153c5776-28ea-4b88-b692-fc1ee145e6dc', '89a039f0-af50-4be6-96e7-c2a3698d5144', '22d88dc5-1e20-4ce5-b224-a55bea6c2304', 'c5c29d6f-7489-45e1-8183-08f2d7095d33', 'ca7e639c-697c-438d-b550-983a53fa2d55', '0f73f976-0a71-450e-b4d0-b6746ce641e7', 'bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9', 'a7dcf68e-77c7-4c96-8393-9ad6248f6c31', '5c2e75af-7b53-4662-af96-bb7c5bccaeba', 'cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4', '549b1fb9-6c49-4106-8a22-052debb3b7f9', 'ab84161a-cc47-4bb7-8bc3-f695a8be1c0a', '4362ce77-85ac-42be-8249-4cf8afc1e957'} {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.400560] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1052.419198] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.419538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.419538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.420944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.420944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.420944] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1052.420944] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.420944] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1052.433412] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.516529] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.517171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.517469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.517951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.519883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.520366] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1052.520629] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1052.520873] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1052.521424] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1052.521719] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/52 resources of Type:Security Group Rules [ 1052.522016] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGH for action security_group_rules [ 1052.522330] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGH for action security_group_rules [ 1052.522642] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGH for action security_group_rules [ 1052.525028] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGH for action security_group_rules [ 1052.526390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.942338] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.010191] env[63014]: INFO networking_nsxv3.common.synchronization [req-bbede143-a793-4f27-908d-e8f680069c55 req-f878700e-41b4-4c9f-8137-5b97f5f5ae50 tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1053.010704] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1053.010848] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 with Priority: HIGH for action security_group_rules [ 1053.010948] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGH for action security_group_rules [ 1053.012179] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 546a1fbc-63de-4ead-af89-1f218af29386 with Priority: HIGH for action security_group_rules [ 1053.012179] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGH for action security_group_rules [ 1053.012179] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 with Priority: HIGH for action security_group_rules [ 1053.012334] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 with Priority: HIGH for action security_group_rules [ 1053.012334] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 with Priority: HIGH for action security_group_rules [ 1053.012406] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGH for action security_group_rules [ 1053.012489] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58b78822-d387-4773-a568-316aa746de6a with Priority: HIGH for action security_group_rules [ 1053.012542] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 with Priority: HIGH for action security_group_rules [ 1053.012626] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 with Priority: HIGH for action security_group_rules [ 1053.012709] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 294457ec-0617-4c91-a38e-e6195397f5a3 with Priority: HIGH for action security_group_rules [ 1053.012798] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d19bea52-b73c-4d06-87a2-c45103884998 with Priority: HIGH for action security_group_rules [ 1053.012883] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 with Priority: HIGH for action security_group_rules [ 1053.012969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGH for action security_group_rules [ 1053.013061] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e with Priority: HIGH for action security_group_rules [ 1053.013141] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb with Priority: HIGH for action security_group_rules [ 1053.013222] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b799ddde-e254-4e10-850e-ade205a5fd9b with Priority: HIGH for action security_group_rules [ 1053.013301] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb with Priority: HIGH for action security_group_rules [ 1053.013399] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGH for action security_group_rules [ 1053.013742] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.013808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.015018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.015018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.015018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.015018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.015018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.015018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.015018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.015018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.015548] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.015686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.015752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.015895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.015964] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83b49506-3ed3-4eac-ace0-a5b2e6ee77b0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.016759] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.016864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.016952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.017082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.017319] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.017994] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-546a1fbc-63de-4ead-af89-1f218af29386 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.018110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.018168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.018315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.018382] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('546a1fbc-63de-4ead-af89-1f218af29386',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.019082] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.019180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.019247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.019448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.019524] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.020216] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a204f6f-e771-4e85-aa7c-c93c90225b83 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.020326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.020390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.020538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.020607] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a204f6f-e771-4e85-aa7c-c93c90225b83',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.021331] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-864e57d5-1404-49e7-b86e-6aa5865742d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.021444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.021510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.021661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.021732] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('864e57d5-1404-49e7-b86e-6aa5865742d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.022532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.022676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.022734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.022885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.022955] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3082e67-cc51-4dbb-a0f9-69738e0314d0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.025753] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.025753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.025753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.025753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.025753] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.025753] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58b78822-d387-4773-a568-316aa746de6a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.025753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.025753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.025753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.025753] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58b78822-d387-4773-a568-316aa746de6a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.028432] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50835d8-af5a-48b2-b8ae-a4f696900f48 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.028432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.028432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.028432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.028432] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50835d8-af5a-48b2-b8ae-a4f696900f48',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.028432] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.028432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.028432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.028432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.028432] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b654582e-9aa5-4cb5-919f-974e7b4e9f66',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.028432] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-294457ec-0617-4c91-a38e-e6195397f5a3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.029148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.029148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.029148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.029148] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('294457ec-0617-4c91-a38e-e6195397f5a3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.030049] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d19bea52-b73c-4d06-87a2-c45103884998 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.030049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.030049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.030049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.030049] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d19bea52-b73c-4d06-87a2-c45103884998',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.030687] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b31bea8a-6eb8-474e-9f80-c659e23a5477 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.030795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.030856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.031013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.031088] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b31bea8a-6eb8-474e-9f80-c659e23a5477',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.031811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.031921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.031987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.032148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.032221] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.032861] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.032965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.033086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.033245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.033313] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d7ee0cf-ae1b-49b2-a857-8517362a3d5e',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.034131] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.034242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.034301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.034452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.034520] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b5e3c0e-e904-4e19-9ad4-9885064b94bb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.035168] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b799ddde-e254-4e10-850e-ade205a5fd9b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.035275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.035335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.035481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.035585] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b799ddde-e254-4e10-850e-ade205a5fd9b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.036225] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.036329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.036394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.036574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.036613] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('010d89fa-3730-42a5-9a3c-78c8b3dd3fbb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.037355] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.037477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.037523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.038341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.038341] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.426401] env[63014]: INFO networking_nsxv3.common.synchronization [req-845d9f73-5e74-473b-a48d-93174f62257e req-aea2004e-fb90-4c7d-a62a-f03e4d25b748 tempest-ListServersNegativeTestJSON-211585463 tempest-ListServersNegativeTestJSON-211585463-project-member] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1053.427455] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1053.427954] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.429089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.429089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.429089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.429089] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.429089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.429089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.429388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.429388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.430802] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.444595] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.444595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.444595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.444829] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.444944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.445638] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1053.465699] env[63014]: INFO networking_nsxv3.common.synchronization [req-26a7e333-295b-428d-ac4a-4655e42f524e req-d499bcc0-7b3a-44d5-8279-7c9d9d145f15 tempest-ListServersNegativeTestJSON-211585463 tempest-ListServersNegativeTestJSON-211585463-project-member] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1053.466272] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGHEST for action security_group_members [ 1053.466869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.466969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.476829] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.477812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.477812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.477812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.477812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.487180] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1053.539816] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.539984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.540067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.540364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.544395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.544395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.550634] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.550826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.550930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.551136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.551561] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.551806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.551906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.552076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.552168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.552256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.552343] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.554238] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.554238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.554238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.554449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.554449] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.554542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.554542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.554665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.554794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.554855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.554902] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.564574] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.564875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.564957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.565173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.565342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.565425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.565487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.565631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.565789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.565883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.565981] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.586058] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.586295] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.586426] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.586718] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.587028] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.587185] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.587308] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.587525] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.587671] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.587896] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1053.588082] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.588197] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.588308] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.588420] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1053.588525] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.588661] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.623296] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.623425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.637026] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.637168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.640231] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.640333] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.645044] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.645150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.645938] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.646050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.646760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.646959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.647072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.647135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.647335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.647415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.647502] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 1053.648966] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.649118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.649176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.649323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.651178] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.651313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.651941] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.652065] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.653271] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.653402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.657152] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.657152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.661188] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.661302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.668686] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.669213] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.669341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.673848] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.674368] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.674505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.675608] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.676072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.676248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.676865] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.677318] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.677424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.683039] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.683526] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.683618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.686165] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1053.686556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.686693] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b654582e-9aa5-4cb5-919f-974e7b4e9f66 is going to be deleted. [ 1053.687649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.687889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.716010] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.716329] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.128 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1053.716540] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.716753] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-95" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.717104] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-8304a2e6-447a-4fff-abd7-eeba291097d1 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.717290] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-8304a2e6-447a-4fff-abd7-eeba291097d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.717443] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-8304a2e6-447a-4fff-abd7-eeba291097d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.717804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-8304a2e6-447a-4fff-abd7-eeba291097d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.717952] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8304a2e6-447a-4fff-abd7-eeba291097d1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.732028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.732028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b799ddde-e254-4e10-850e-ade205a5fd9b is going to be deleted. [ 1053.732929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.733161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.734775] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.734893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.734893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.735096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.735228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.748263] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1053.755306] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.755429] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d7ee0cf-ae1b-49b2-a857-8517362a3d5e is going to be deleted. [ 1053.756291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.756495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.775980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.776098] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 546a1fbc-63de-4ead-af89-1f218af29386 is going to be deleted. [ 1053.776890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.777096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.786355] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.786495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.843385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.843543] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3082e67-cc51-4dbb-a0f9-69738e0314d0 is going to be deleted. [ 1053.844461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.845119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.846658] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.846806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.858092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.858251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.932584] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.932584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.940727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.940727] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 864e57d5-1404-49e7-b86e-6aa5865742d0 is going to be deleted. [ 1053.941795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.942071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.984993] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.985416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.999888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.000064] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50835d8-af5a-48b2-b8ae-a4f696900f48 is going to be deleted. [ 1054.000992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.001202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.036235] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.036656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.073292] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.078046] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.078794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.078936] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d19bea52-b73c-4d06-87a2-c45103884998 is going to be deleted. [ 1054.080155] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.081240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.081240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.094804] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.095070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.180560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.180770] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b31bea8a-6eb8-474e-9f80-c659e23a5477 is going to be deleted. [ 1054.181660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.181892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.219969] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.220247] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.220381] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.220737] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.220892] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.221107] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 8304a2e6-447a-4fff-abd7-eeba291097d1 not found, creating... [ 1054.221355] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.221520] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.221642] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.221885] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.222084] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.222422] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.222609] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.222760] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.223015] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.223217] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.223363] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 8304a2e6-447a-4fff-abd7-eeba291097d1 is going to be created. [ 1054.227594] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.227762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.250381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.250532] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 010d89fa-3730-42a5-9a3c-78c8b3dd3fbb is going to be deleted. [ 1054.251547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.251775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.251867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.251974] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be deleted. [ 1054.256221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.256476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.450146] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.450389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.459235] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.459462] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.459594] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.459893] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.460178] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.460419] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-8304a2e6-447a-4fff-abd7-eeba291097d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.462391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.462499] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a204f6f-e771-4e85-aa7c-c93c90225b83 is going to be deleted. [ 1054.464090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.464090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.517595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.517857] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 294457ec-0617-4c91-a38e-e6195397f5a3 is going to be deleted. [ 1054.518658] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.518897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.523538] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.523680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.573469] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.573469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.575341] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db110989-027c-4ed8-b5db-6b256912c344: rpc.has_security_group_logging(os_id): False [ 1054.583034] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f61fdd6-c6dd-47e0-9456-36df63f208a2: rpc.has_security_group_logging(os_id): False [ 1054.583986] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b44cf44-3516-4644-9659-498297843d9a: rpc.has_security_group_logging(os_id): False [ 1054.601484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.601709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.625604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.625604] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58b78822-d387-4773-a568-316aa746de6a is going to be deleted. [ 1054.626475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.626711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.637440] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.637530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.655928] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.656116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.675546] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.675773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.676097] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.676186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.716989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.716989] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83b49506-3ed3-4eac-ace0-a5b2e6ee77b0 is going to be deleted. [ 1054.717695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.717911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.752012] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.752255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.841977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.841977] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b5e3c0e-e904-4e19-9ad4-9885064b94bb is going to be deleted. [ 1054.842892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.843124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.843951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b654582e-9aa5-4cb5-919f-974e7b4e9f66" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.843951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.843951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b799ddde-e254-4e10-850e-ade205a5fd9b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.845022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.845022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.845022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.845022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d7ee0cf-ae1b-49b2-a857-8517362a3d5e" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.845022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.845230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.872558] env[63014]: INFO networking_nsxv3.common.synchronization [req-bbede143-a793-4f27-908d-e8f680069c55 req-f0d1c1f0-8fce-4036-9857-c973f012d48c service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 1054.872837] env[63014]: INFO networking_nsxv3.common.synchronization [req-bbede143-a793-4f27-908d-e8f680069c55 req-f0d1c1f0-8fce-4036-9857-c973f012d48c service nova] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1054.873042] env[63014]: INFO networking_nsxv3.common.synchronization [req-bbede143-a793-4f27-908d-e8f680069c55 req-f0d1c1f0-8fce-4036-9857-c973f012d48c service nova] Enqueued Resource ID: 8304a2e6-447a-4fff-abd7-eeba291097d1 with Priority: HIGHEST for action port [ 1054.873619] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_rules [ 1054.873775] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1054.873955] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8304a2e6-447a-4fff-abd7-eeba291097d1 with Priority: HIGHEST for action port [ 1054.874302] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.874440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.874675] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.874771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.874992] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8304a2e6-447a-4fff-abd7-eeba291097d1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.875137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8304a2e6-447a-4fff-abd7-eeba291097d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.875197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8304a2e6-447a-4fff-abd7-eeba291097d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.875453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8304a2e6-447a-4fff-abd7-eeba291097d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.875514] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8304a2e6-447a-4fff-abd7-eeba291097d1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.877172] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.877308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.894415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.894544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.912355] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1054.912912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.913171] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.913295] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.913362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.913556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.913640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.913884] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1054.914890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.915640] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.915805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.915945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-546a1fbc-63de-4ead-af89-1f218af29386" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.916116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.916280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.916360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.916466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3082e67-cc51-4dbb-a0f9-69738e0314d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.917161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.917325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.917408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.917538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-864e57d5-1404-49e7-b86e-6aa5865742d0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.917681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.917994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.918115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.918235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50835d8-af5a-48b2-b8ae-a4f696900f48" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.918365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.918512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.918587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.918697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d19bea52-b73c-4d06-87a2-c45103884998" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.918821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.918958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.919395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.919545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b31bea8a-6eb8-474e-9f80-c659e23a5477" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.919675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.919823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.919900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.920014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.920143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.920465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.920559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.920677] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a204f6f-e771-4e85-aa7c-c93c90225b83" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.920792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.920938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.921024] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.921998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.922634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.995103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.995958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.995958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.995958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.995958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.995958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.996254] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1054.997321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.997396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.997434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.997818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-010d89fa-3730-42a5-9a3c-78c8b3dd3fbb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.997818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.997818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.015528] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.015676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.015761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.015982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.016139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.037559] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1055.038349] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.038473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.043931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.044250] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.044361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.044413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.044617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.044742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.044819] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be updated. [ 1055.045856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.046802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.046903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.047194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-294457ec-0617-4c91-a38e-e6195397f5a3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.048031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.048031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.048031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.048031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58b78822-d387-4773-a568-316aa746de6a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.048031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.048265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.048265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.048354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83b49506-3ed3-4eac-ace0-a5b2e6ee77b0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.048480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.048656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.101673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.101927] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.102090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.102149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.102346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.102432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.102526] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 is going to be updated. [ 1055.103624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.103810] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.103913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.104386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b5e3c0e-e904-4e19-9ad4-9885064b94bb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.151222] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.151404] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.151633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.151782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.151846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.176018] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1055.222610] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.222610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.222610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.222767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.222850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.248484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.248659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.248721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.248917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.249070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.254349] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 2s [ 1055.272469] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1055.272469] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 in Status: IN_PROGRESS for 2s [ 1055.382236] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8304a2e6-447a-4fff-abd7-eeba291097d1 with status ACTIVE [ 1055.382236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.382236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.382236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.382236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.382236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.382236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.382236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.382236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.382236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.382236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.382236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.382902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.382902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.382902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.382902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.382902] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8304a2e6-447a-4fff-abd7-eeba291097d1 is going to be updated. [ 1055.410258] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.410557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.410557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.411374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.411374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.411374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8304a2e6-447a-4fff-abd7-eeba291097d1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.428045] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.428045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.497148] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1055.497381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.498362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.498791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.498829] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.498953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.499032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.499205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.499281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.499370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.499463] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.759812] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1055.759990] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 deletion is rescheduled due to dependency. [ 1055.760112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.760305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.760587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.760668] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.760795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.760854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.761020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.761117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.761201] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.003860] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.003860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.003860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.004381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.004381] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.004381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.004381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.004525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.004560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.004727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.004846] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.004846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.004969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.005079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.005198] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.005292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.005355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.005491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.005567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.005647] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.005816] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.264267] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.508358] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c29d6f-7489-45e1-8183-08f2d7095d33: rpc.has_security_group_logging(os_id): False [ 1056.524640] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.524784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.524858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.525158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.541943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.542225] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.542347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.542416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.542617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.542701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.542920] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.543057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.543138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.543368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.543452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.543688] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.543762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.543849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.543999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.544101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.544215] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1056.602101] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.602386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.602483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.602806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.602952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.616468] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1056.766173] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.048116] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1057.048425] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 deletion is rescheduled due to dependency. [ 1057.048425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.048565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.048781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.048966] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.049098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.049196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.049395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.049524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.049678] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.189159] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1057.189453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.266327] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 1057.266478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.269313] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.269313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.269313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.269576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.269633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.269720] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 1057.281944] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 in Status: SUCCESS [ 1057.282255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.298172] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.298352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.298396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.298610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.298759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.306069] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1057.552586] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.552737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.552737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.552915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.553015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.553225] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.553320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.553374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.553584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.553650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.553706] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1057.577645] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.577834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.577898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.578116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.578258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.585666] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1058.630597] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1058.630597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.318414] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1059.318709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.318900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.319152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.319358] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.320029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.320029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.320029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.320029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.320029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.320257] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.596940] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1059.596940] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 deletion is rescheduled due to dependency. [ 1059.596940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.597322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.597322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.597618] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.597800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.597904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.598183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.598322] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.598471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.598615] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.824209] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.824682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.824682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.824682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.824846] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.824952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.825040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.825201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.825297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.825369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.825525] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.825620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.826280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.826280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.826280] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.826280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.826280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.826549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.826549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.826549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.826683] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.875425] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1059.875620] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1060.101211] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.101387] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.101459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.101691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.101868] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.101971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.102051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.102205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.102293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.102383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.102535] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.102627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.102690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.102836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.102973] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.103078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.103143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.103285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.103366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.103450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.103543] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.328434] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ee7fd9b-59b4-4423-847c-b926a3ab5883: rpc.has_security_group_logging(os_id): False [ 1060.345356] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.345356] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.345356] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.345591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.345591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.345788] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.345937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.346013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.346178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.346254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.346444] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.346537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.346598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.346734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.346924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.347083] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.347194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.347259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.347401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.347477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.347563] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be created. [ 1060.428129] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.428376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.428376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.428595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.428779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.444285] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1060.609458] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8019faa-8b2f-47fe-bceb-e7ffa5b64330: rpc.has_security_group_logging(os_id): False [ 1060.629050] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.629254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.629254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.629599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.629713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.629828] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.629929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.629986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.630192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.630278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.630561] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.630691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.630751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.630908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.630987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.631221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.631472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.631472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.631605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.631605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.631753] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be updated. [ 1060.694090] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.694090] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.694243] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.695818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.695818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.711278] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: IN_PROGRESS for 2s [ 1061.224420] env[63014]: INFO networking_nsxv3.common.synchronization [req-b63a5da4-eaa4-4580-980a-da0367dc558a req-36913ba1-9e84-401f-8c83-d83cb402037c tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1061.224966] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1061.225282] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.225390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.225459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.225657] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.225869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.226038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.226038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.226915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.226915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.226915] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.728432] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.022610] env[63014]: INFO networking_nsxv3.common.synchronization [None req-a93ae576-a245-495d-9ec5-fde059de3884 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 5e1551be-a671-44f5-b343-0edf77350861 with Priority: HIGHEST for action security_group_rules [ 1062.031495] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e1551be-a671-44f5-b343-0edf77350861 with Priority: HIGHEST for action security_group_rules [ 1062.031495] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e1551be-a671-44f5-b343-0edf77350861 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.031495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e1551be-a671-44f5-b343-0edf77350861" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.031495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e1551be-a671-44f5-b343-0edf77350861" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.032037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e1551be-a671-44f5-b343-0edf77350861" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.032037] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e1551be-a671-44f5-b343-0edf77350861',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.148228] env[63014]: INFO networking_nsxv3.common.synchronization [None req-ca5b9f15-cdba-4fd7-96dd-dfc6417e7d7b tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 5e1551be-a671-44f5-b343-0edf77350861 with Priority: HIGHEST for action security_group_rules [ 1062.148943] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e1551be-a671-44f5-b343-0edf77350861 with Priority: HIGHEST for action security_group_rules [ 1062.149345] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e1551be-a671-44f5-b343-0edf77350861 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.149507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e1551be-a671-44f5-b343-0edf77350861" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.230716] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.308893] env[63014]: INFO networking_nsxv3.common.synchronization [req-4aa85000-4416-4fa7-849d-32c5a19b61e5 req-a2b85a41-aca1-459b-abde-f2e1574030ae tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1062.308893] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1062.308988] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.309088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.309173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.309353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.309606] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.309606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.309730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.309803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.310692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.310692] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.474785] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1062.475045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.551133] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.551379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.551379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.551480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.551542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.551667] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e1551be-a671-44f5-b343-0edf77350861 already deleted. [ 1062.551724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e1551be-a671-44f5-b343-0edf77350861" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.551885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e1551be-a671-44f5-b343-0edf77350861" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.552056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e1551be-a671-44f5-b343-0edf77350861" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.552129] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e1551be-a671-44f5-b343-0edf77350861',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.725248] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 in Status: SUCCESS [ 1062.725483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.734164] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.734358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.734442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.734673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.734767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.734869] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1062.761389] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.761582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.761626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.761838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.761986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.775308] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1062.812309] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.812497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.812541] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.812793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.846910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.847329] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.847516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.847603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.847830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.847965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.848097] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1062.881039] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.881255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.881372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.881687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.881828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.892131] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1063.071981] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.072151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.072269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.072616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.072616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.072715] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e1551be-a671-44f5-b343-0edf77350861 already deleted. [ 1063.072798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e1551be-a671-44f5-b343-0edf77350861" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.302923] env[63014]: INFO networking_nsxv3.common.synchronization [req-e6a3352a-6a23-400d-b065-12a607d70f02 req-c4636f00-3a43-41cd-a225-45670b69fec2 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 1064.302923] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 1064.302923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.302923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.302923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.308091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.308091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.308091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.308091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.308091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.308091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.308091] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.785095] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1064.785353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.807603] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.807814] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.807949] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.808267] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.808540] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.808719] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.808839] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.809116] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.809279] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.809494] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.809634] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.809750] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.809861] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.809985] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1064.810151] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.810280] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.811656] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.828144] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.828312] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1064.828567] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.828635] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-830" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.828902] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-afd71537-c03a-4298-99da-062753857a37 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.829097] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-afd71537-c03a-4298-99da-062753857a37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.829225] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-afd71537-c03a-4298-99da-062753857a37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.829547] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-afd71537-c03a-4298-99da-062753857a37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.829691] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afd71537-c03a-4298-99da-062753857a37',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.899936] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1064.900116] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1064.900235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.313170] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.332020] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.333057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.333057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.333057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.333057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.333057] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port afd71537-c03a-4298-99da-062753857a37 not found, creating... [ 1065.333274] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.333437] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.333567] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.333794] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.333937] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.334234] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.334396] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.334516] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.334727] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.334902] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.335075] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: afd71537-c03a-4298-99da-062753857a37 is going to be created. [ 1065.353925] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.354136] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.354269] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.354499] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.354721] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.354936] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-afd71537-c03a-4298-99da-062753857a37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.815526] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.815526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.815526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.815752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.815791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.815945] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be updated. [ 1065.841402] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.841571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.841612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.841812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.841957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.851372] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 2s [ 1065.869797] env[63014]: INFO networking_nsxv3.common.synchronization [req-7a8fc45e-073c-4b40-8e4e-760a38ade16d req-84653b2f-6868-46dd-a616-196a5e7c9950 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1065.870266] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1065.870571] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.870694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.870761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.870964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.871298] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.871403] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.871459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.871626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.871711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.871802] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.121750] env[63014]: INFO networking_nsxv3.common.synchronization [req-e6a3352a-6a23-400d-b065-12a607d70f02 req-f14eb10f-91c3-4348-bc14-3c6aa65f2272 service nova] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_rules [ 1066.121944] env[63014]: INFO networking_nsxv3.common.synchronization [req-e6a3352a-6a23-400d-b065-12a607d70f02 req-f14eb10f-91c3-4348-bc14-3c6aa65f2272 service nova] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 1066.122103] env[63014]: INFO networking_nsxv3.common.synchronization [req-e6a3352a-6a23-400d-b065-12a607d70f02 req-f14eb10f-91c3-4348-bc14-3c6aa65f2272 service nova] Enqueued Resource ID: afd71537-c03a-4298-99da-062753857a37 with Priority: HIGHEST for action port [ 1066.122588] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_rules [ 1066.122720] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 1066.122829] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afd71537-c03a-4298-99da-062753857a37 with Priority: HIGHEST for action port [ 1066.123324] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.123499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.123606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.123843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.124036] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.126465] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.126465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.126465] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-afd71537-c03a-4298-99da-062753857a37 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.126465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afd71537-c03a-4298-99da-062753857a37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.126465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afd71537-c03a-4298-99da-062753857a37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.126465] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afd71537-c03a-4298-99da-062753857a37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.126465] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afd71537-c03a-4298-99da-062753857a37',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.373727] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.376141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.376141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.376141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.398582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.398884] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.399055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.399132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.399410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.399477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.399587] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1066.423907] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.424129] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.424180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.424400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.424564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.431938] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1066.628017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.628213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.628411] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port afd71537-c03a-4298-99da-062753857a37 with status ACTIVE [ 1066.629033] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.629033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.629033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.629033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.629251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.629251] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.629402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.629402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.629571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.629642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.629805] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.629902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.629947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.630103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.630242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.630391] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: afd71537-c03a-4298-99da-062753857a37 is going to be updated. [ 1066.648923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.649157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.649247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.649430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.649570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.649756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afd71537-c03a-4298-99da-062753857a37" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.861525] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 1067.861850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.861850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.862126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.863072] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.863072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.863072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.863072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.863072] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.863072] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.365432] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.441377] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1068.441706] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 1068.441706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.868172] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.370869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.371198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.371198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.371434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.371535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.371642] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be updated. [ 1069.398227] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.398499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.398894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.398894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.399080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.409091] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 2s [ 1071.123735] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1071.124131] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1071.419478] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 1071.419731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.419924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.420181] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.420379] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.420503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.420568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.420728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.420839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.421035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.421137] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.924075] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.025641] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.025851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.025980] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.026308] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.026585] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.026753] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.026875] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.027157] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.027291] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.027504] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.027620] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.027732] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.027843] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.027958] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1072.028083] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.028223] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.049064] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.049064] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1072.049064] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.049064] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-270" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.049436] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-a79337cb-17e6-4dc8-be90-90a6d3823771 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.049689] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.049870] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.050249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.050466] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79337cb-17e6-4dc8-be90-90a6d3823771',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.427995] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b44cf44-3516-4644-9659-498297843d9a: rpc.has_security_group_logging(os_id): False [ 1072.443051] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.443239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.443363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.443683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.443818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.444176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.444321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.444423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.444661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.444792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.444921] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be updated. [ 1072.499165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.499347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.499419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.499652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.499843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.516483] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 2s [ 1072.553041] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.553347] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.553528] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.553827] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.553985] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.554302] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.554469] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.554594] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.554852] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.555044] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.555510] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.555705] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.555832] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.556126] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.556438] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.556685] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: a79337cb-17e6-4dc8-be90-90a6d3823771 is going to be updated. [ 1072.595087] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.595332] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.595464] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.595740] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.595940] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.596252] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.287330] env[63014]: INFO networking_nsxv3.common.synchronization [req-6952937b-2c17-42a7-a206-cb036d4e8fa7 req-c78dd206-9e2b-4844-b61b-c02823c29116 service nova] Enqueued Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_rules [ 1073.287330] env[63014]: INFO networking_nsxv3.common.synchronization [req-6952937b-2c17-42a7-a206-cb036d4e8fa7 req-c78dd206-9e2b-4844-b61b-c02823c29116 service nova] Enqueued Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_members [ 1073.287330] env[63014]: INFO networking_nsxv3.common.synchronization [req-6952937b-2c17-42a7-a206-cb036d4e8fa7 req-c78dd206-9e2b-4844-b61b-c02823c29116 service nova] Enqueued Resource ID: a79337cb-17e6-4dc8-be90-90a6d3823771 with Priority: HIGHEST for action port [ 1073.287330] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_rules [ 1073.287330] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_members [ 1073.287330] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79337cb-17e6-4dc8-be90-90a6d3823771 with Priority: HIGHEST for action port [ 1073.288305] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.288776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.288937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.289244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.289420] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.290642] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.290889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.291053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.293018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.293018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.293018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.293018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.293018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.293018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.293018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.293018] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-a79337cb-17e6-4dc8-be90-90a6d3823771 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.293018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.293018] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.294990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.294990] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79337cb-17e6-4dc8-be90-90a6d3823771',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.794605] env[63014]: INFO networking_nsxv3.common.synchronization [req-282cb089-1117-4ec7-9c55-927a7e70cafd req-1c2b56a9-ee31-456f-a346-70cec90f66a4 tempest-ImagesTestJSON-780710689 tempest-ImagesTestJSON-780710689-project-member] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1073.795414] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGHEST for action security_group_members [ 1073.796122] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.796122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.796299] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.799943] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.799943] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.800188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.800273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.800582] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.800747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.800848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.801107] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.801696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.801696] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.803257] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a79337cb-17e6-4dc8-be90-90a6d3823771 with status ACTIVE [ 1073.803342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.803452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.803534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.803796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.803892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.804159] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.804308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.804408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.804627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.804751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.805039] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.805187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.805283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.805496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.805614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.805754] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a79337cb-17e6-4dc8-be90-90a6d3823771 is going to be updated. [ 1073.828380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.828525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.828525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.828678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.828816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.828972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a79337cb-17e6-4dc8-be90-90a6d3823771" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.304053] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.308296] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.308436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.308526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.308881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.309257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.309257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.309440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.309440] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.309539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.309623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.309713] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be updated. [ 1074.335812] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.335812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.335812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.335812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.336043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.342823] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: IN_PROGRESS for 2s [ 1074.529454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 1074.529695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.806241] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.806661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.806661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.806737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.806772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.806874] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 is going to be updated. [ 1074.832087] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.832275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.832275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.832482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.832633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.841347] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: IN_PROGRESS for 2s [ 1076.352250] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 in Status: SUCCESS [ 1076.352526] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 deletion is rescheduled due to dependency. [ 1076.352573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.849583] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: SUCCESS [ 1076.849775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.850027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.850218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.850464] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.850567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.850617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.850783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.850868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.850957] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.851070] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.353621] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.856171] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f73f976-0a71-450e-b4d0-b6746ce641e7: rpc.has_security_group_logging(os_id): False [ 1077.878136] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.878297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.878371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.878620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.898643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.899016] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.899167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.899262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.899548] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.899674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.899840] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 is going to be updated. [ 1077.957337] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.957337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.957337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.957567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.957732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.970442] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: IN_PROGRESS for 2s [ 1078.796652] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1078.797060] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1079.271237] env[63014]: INFO networking_nsxv3.common.synchronization [req-6192d57a-e095-4bc2-ab35-c5a5efc8a9c4 req-01ad1f0c-e42d-499c-8f67-5596df3678e8 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1079.271237] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1079.271237] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.271237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.271237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.271237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.271237] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.271237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.271237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.271237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.271237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.271237] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.586037] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.586259] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.586418] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.586694] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.586982] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.587158] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.587293] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.587594] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.587767] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.587979] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.588177] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.588223] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.588326] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.588440] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1079.588547] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.588679] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.606302] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.606537] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1079.606683] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.606880] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.607383] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-a439746e-cd86-42ba-b508-bd116e44afb3 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.607592] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-a439746e-cd86-42ba-b508-bd116e44afb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.607757] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-a439746e-cd86-42ba-b508-bd116e44afb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.608106] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-a439746e-cd86-42ba-b508-bd116e44afb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.608296] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a439746e-cd86-42ba-b508-bd116e44afb3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.778052] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.778052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.778052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.778052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.778052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.778052] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.778052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.778052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.778052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.778431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.778431] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1079.807530] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.807830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.807830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.807906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.808042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.815422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1079.984597] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: SUCCESS [ 1079.984904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.110405] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.110631] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.110704] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.111016] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.111182] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.111347] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port a439746e-cd86-42ba-b508-bd116e44afb3 not found, creating... [ 1080.111614] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.111775] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.111898] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.112145] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.112290] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.112585] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.112739] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.112896] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.113146] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.113288] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.113435] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: a439746e-cd86-42ba-b508-bd116e44afb3 is going to be created. [ 1080.132707] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.132939] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.133070] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.133362] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.133593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.133827] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-a439746e-cd86-42ba-b508-bd116e44afb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.862656] env[63014]: INFO networking_nsxv3.common.synchronization [req-6192d57a-e095-4bc2-ab35-c5a5efc8a9c4 req-f23b4882-3b74-4e57-983b-02cfe0b8d862 service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 1080.862656] env[63014]: INFO networking_nsxv3.common.synchronization [req-6192d57a-e095-4bc2-ab35-c5a5efc8a9c4 req-f23b4882-3b74-4e57-983b-02cfe0b8d862 service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1080.862656] env[63014]: INFO networking_nsxv3.common.synchronization [req-6192d57a-e095-4bc2-ab35-c5a5efc8a9c4 req-f23b4882-3b74-4e57-983b-02cfe0b8d862 service nova] Enqueued Resource ID: a439746e-cd86-42ba-b508-bd116e44afb3 with Priority: HIGHEST for action port [ 1080.863165] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 1080.863363] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1080.863535] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a439746e-cd86-42ba-b508-bd116e44afb3 with Priority: HIGHEST for action port [ 1080.863869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.864040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.864134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.866197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.866197] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.866197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.866197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.866197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-a439746e-cd86-42ba-b508-bd116e44afb3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.866197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a439746e-cd86-42ba-b508-bd116e44afb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.866197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a439746e-cd86-42ba-b508-bd116e44afb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.866690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a439746e-cd86-42ba-b508-bd116e44afb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.866690] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a439746e-cd86-42ba-b508-bd116e44afb3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.368059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.368284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.368421] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a439746e-cd86-42ba-b508-bd116e44afb3 with status ACTIVE [ 1081.368603] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.368728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.368814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.369131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.369242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.369424] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.369524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.369584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.369739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.369816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.370028] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.370173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.370173] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.370455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.370455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.370591] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a439746e-cd86-42ba-b508-bd116e44afb3 is going to be updated. [ 1081.392012] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.392233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.392335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.392563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.392734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.392912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a439746e-cd86-42ba-b508-bd116e44afb3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.824994] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1081.825193] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 1081.825313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.825482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.825721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.825993] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.826138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.826204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.826483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.826655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.826773] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.329556] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.832375] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.334992] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.335299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.335299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.335496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.335595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.335696] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1083.362179] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.362335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.362407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.362669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.362892] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.370784] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1085.386800] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1085.387119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.387210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.387428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.387623] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.387736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.387802] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.387958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.388055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.388141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.388310] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.864352] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1085.864466] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1085.892148] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.892374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.892374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.892851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.893147] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.893288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.893288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.893522] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.893644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.893755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.893958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.894100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.894175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.894401] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.894575] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.894693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.894764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.894937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.895071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.895185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.895296] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.397784] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b917177-fad2-4a8d-bb56-2b4d47acad21: rpc.has_security_group_logging(os_id): False [ 1086.415306] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.415537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.415537] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.415753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.415938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.416119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.416216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.416281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.416443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.416577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.416732] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.416871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.416929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.417081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.417158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.417342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.417498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.417586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.417698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.418032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.418032] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1086.477015] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.477235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.477280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.477542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.480054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.493980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1087.743055] env[63014]: INFO networking_nsxv3.common.synchronization [req-581d9212-4693-40f6-bf4b-10ed7ea6dbaa req-216da576-43f4-4744-9146-d0b5d9b30c67 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1087.743681] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1087.743990] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.744121] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.744182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.744377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.744543] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.744635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.744684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.744850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.744935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.745033] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.247367] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.273242] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.273242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.273242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.273242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.273242] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.273242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.273242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.273242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.273601] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.273601] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.273601] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.273704] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.273819] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.274246] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.274246] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.274246] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.292166] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.292352] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1088.292496] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.292670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.292983] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.293170] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.293294] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.293631] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.293775] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7099adc3-5af8-4c5d-81f5-1eecc96a6c47',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.509959] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1088.510247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.750783] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.796588] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.797090] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.797090] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.797305] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.797476] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.797659] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 7099adc3-5af8-4c5d-81f5-1eecc96a6c47 not found, creating... [ 1088.797955] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.798151] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.798292] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.800024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.800024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.800024] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.800024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.800024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.800024] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.800265] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.800265] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 7099adc3-5af8-4c5d-81f5-1eecc96a6c47 is going to be created. [ 1088.821853] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.822107] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.822249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.822538] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.822806] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.823064] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.066391] env[63014]: INFO networking_nsxv3.common.synchronization [None req-bf78e162-a672-4c4f-bcd5-763f8854fbf7 None None] Enqueued Resource ID: 2dbceef5-401f-49c2-8661-3aef097fc4b7 with Priority: HIGHEST for action port [ 1089.066498] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dbceef5-401f-49c2-8661-3aef097fc4b7 with Priority: HIGHEST for action port [ 1089.067492] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dbceef5-401f-49c2-8661-3aef097fc4b7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.067492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dbceef5-401f-49c2-8661-3aef097fc4b7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.067492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dbceef5-401f-49c2-8661-3aef097fc4b7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.067811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dbceef5-401f-49c2-8661-3aef097fc4b7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.067928] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dbceef5-401f-49c2-8661-3aef097fc4b7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.257670] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.260555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.260555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.260555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.260555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.260555] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1089.287826] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.287826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.288013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.288710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.288710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.298236] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1089.569993] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2dbceef5-401f-49c2-8661-3aef097fc4b7 [ 1089.571589] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.571589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.571589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.571589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.571589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.571589] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2dbceef5-401f-49c2-8661-3aef097fc4b7 already deleted. [ 1089.571589] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dbceef5-401f-49c2-8661-3aef097fc4b7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.812016] env[63014]: INFO networking_nsxv3.common.synchronization [req-581d9212-4693-40f6-bf4b-10ed7ea6dbaa req-d67f7377-3439-409d-b715-603256e09127 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1089.812016] env[63014]: INFO networking_nsxv3.common.synchronization [req-581d9212-4693-40f6-bf4b-10ed7ea6dbaa req-d67f7377-3439-409d-b715-603256e09127 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1089.812016] env[63014]: INFO networking_nsxv3.common.synchronization [req-581d9212-4693-40f6-bf4b-10ed7ea6dbaa req-d67f7377-3439-409d-b715-603256e09127 service nova] Enqueued Resource ID: 7099adc3-5af8-4c5d-81f5-1eecc96a6c47 with Priority: HIGHEST for action port [ 1089.812016] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1089.812016] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1089.812411] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7099adc3-5af8-4c5d-81f5-1eecc96a6c47 with Priority: HIGHEST for action port [ 1089.812604] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.812725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.812790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.814031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.814291] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.816037] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.816037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.816037] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.816037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.816037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.816037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.816037] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7099adc3-5af8-4c5d-81f5-1eecc96a6c47',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.317540] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.317722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.322262] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7099adc3-5af8-4c5d-81f5-1eecc96a6c47 with status ACTIVE [ 1090.322462] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.322594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.322667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.322873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.322966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.323156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.323253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.323315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.323466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.323544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.323722] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.323815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.323877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.324027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.324104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.324188] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7099adc3-5af8-4c5d-81f5-1eecc96a6c47 is going to be updated. [ 1090.343775] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.343915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.343977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.344286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.344430] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.344666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7099adc3-5af8-4c5d-81f5-1eecc96a6c47" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.951813] env[63014]: INFO networking_nsxv3.common.synchronization [None req-35fbdfbe-2972-43e7-b723-6d5c24c6c7b4 None None] Enqueued Resource ID: cab83ce7-c67d-4d0c-b176-9378ee8b0c10 with Priority: HIGHEST for action port [ 1090.951813] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cab83ce7-c67d-4d0c-b176-9378ee8b0c10 with Priority: HIGHEST for action port [ 1090.952139] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-cab83ce7-c67d-4d0c-b176-9378ee8b0c10 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.952228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cab83ce7-c67d-4d0c-b176-9378ee8b0c10" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.952300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cab83ce7-c67d-4d0c-b176-9378ee8b0c10" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.952548] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cab83ce7-c67d-4d0c-b176-9378ee8b0c10" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.952630] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cab83ce7-c67d-4d0c-b176-9378ee8b0c10',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.308279] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1091.308279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.308279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.308438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.308724] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.308807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.308807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.309279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.309279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.309279] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.456205] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cab83ce7-c67d-4d0c-b176-9378ee8b0c10 [ 1091.456205] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.456205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.456205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.456205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.456205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.456205] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cab83ce7-c67d-4d0c-b176-9378ee8b0c10 already deleted. [ 1091.456205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cab83ce7-c67d-4d0c-b176-9378ee8b0c10" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.811362] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.319521] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.536281] env[63014]: INFO networking_nsxv3.common.synchronization [req-4cd73c94-6c55-443b-84c0-7c043db621b2 req-1e788d45-75b3-421a-94dd-38407dec7503 tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1092.536856] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1092.537194] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.537317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.537383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.537584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.537757] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.537856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.537915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.538083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.538174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.538264] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.823920] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.823920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.823920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.823920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.823920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.823920] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1092.880750] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.880750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.880750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.880750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.880750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.889226] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1092.951977] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.952234] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.952372] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.952645] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.952912] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.953192] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.953192] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.953418] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.953567] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.953773] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.953891] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.954011] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.954161] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.954260] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.954359] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.954565] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.975021] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.975196] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1092.975343] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.975518] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.975911] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-f873bea6-fe7c-4060-9dd0-aa3772507f21 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.976030] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-f873bea6-fe7c-4060-9dd0-aa3772507f21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.976134] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-f873bea6-fe7c-4060-9dd0-aa3772507f21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.976451] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-f873bea6-fe7c-4060-9dd0-aa3772507f21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.976591] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f873bea6-fe7c-4060-9dd0-aa3772507f21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.040229] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.040434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.040514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.040801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.040919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.041179] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.041296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.041426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.041569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.041662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.042065] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1093.065718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.065864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.065910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.066391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.066391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.075640] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1093.089491] env[63014]: INFO networking_nsxv3.common.synchronization [req-d7b1141c-0c8d-4626-8e1a-ff92cc133502 req-c8d8c5fa-0fce-41c1-9f93-da00faa0da0a tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_members [ 1093.090037] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGHEST for action security_group_members [ 1093.090651] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.090803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.090884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.091119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.091280] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.091383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.091448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.091598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.091685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.091778] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.479597] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.480098] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.480098] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.480411] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.480575] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.480759] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port f873bea6-fe7c-4060-9dd0-aa3772507f21 not found, creating... [ 1093.481090] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.481293] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.481489] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.482749] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.482851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.483233] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.483541] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.483624] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.483925] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.484161] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.484422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: f873bea6-fe7c-4060-9dd0-aa3772507f21 is going to be created. [ 1093.507583] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.507788] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.507998] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.508185] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.508408] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.508630] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-f873bea6-fe7c-4060-9dd0-aa3772507f21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.594596] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.594596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.594777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.595058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.595280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.595481] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.595630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.595705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.595899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.596492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.596492] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 is going to be updated. [ 1093.656365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.656365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.656598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.657096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.657096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.667899] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 in Status: IN_PROGRESS for 2s [ 1094.199751] env[63014]: INFO networking_nsxv3.common.synchronization [req-4cd73c94-6c55-443b-84c0-7c043db621b2 req-2a715253-9304-4bbd-8c49-c08b1e927afc service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1094.199967] env[63014]: INFO networking_nsxv3.common.synchronization [req-4cd73c94-6c55-443b-84c0-7c043db621b2 req-2a715253-9304-4bbd-8c49-c08b1e927afc service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1094.200143] env[63014]: INFO networking_nsxv3.common.synchronization [req-4cd73c94-6c55-443b-84c0-7c043db621b2 req-2a715253-9304-4bbd-8c49-c08b1e927afc service nova] Enqueued Resource ID: f873bea6-fe7c-4060-9dd0-aa3772507f21 with Priority: HIGHEST for action port [ 1094.200362] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1094.200464] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1094.200544] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f873bea6-fe7c-4060-9dd0-aa3772507f21 with Priority: HIGHEST for action port [ 1094.201119] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.201246] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.201379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.201491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.201612] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.202384] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.202499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.202657] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f873bea6-fe7c-4060-9dd0-aa3772507f21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.202756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f873bea6-fe7c-4060-9dd0-aa3772507f21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.204127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f873bea6-fe7c-4060-9dd0-aa3772507f21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.204127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f873bea6-fe7c-4060-9dd0-aa3772507f21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.204127] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f873bea6-fe7c-4060-9dd0-aa3772507f21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.704923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.705220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.705261] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f873bea6-fe7c-4060-9dd0-aa3772507f21 with status ACTIVE [ 1094.705422] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.705526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.705590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.705793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.705885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.706069] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.706165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.706222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.706366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.706441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.706618] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.706767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.706828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.706973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.707057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.707153] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f873bea6-fe7c-4060-9dd0-aa3772507f21 is going to be updated. [ 1094.727581] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.727750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.727837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.728075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.728217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.728376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f873bea6-fe7c-4060-9dd0-aa3772507f21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.898197] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1094.898455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.898530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.898744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.898931] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.899163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.899235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.899395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.899477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.899598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.899645] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.084846] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1095.085042] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1095.085161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.085315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.085542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.085717] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.085835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.085899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.086066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.086151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.086244] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.401758] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.401958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.401958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.402218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.402394] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.402496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.402564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.402709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.402800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.402894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.403114] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.403200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.403200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.403348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.403484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.403574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.403631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.403769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.403845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.403926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.404060] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.590650] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.618239] env[63014]: INFO networking_nsxv3.common.synchronization [req-2388f785-a117-4174-828d-be1c83dbbe1c req-496e4cfd-e157-4ed6-af2a-907c868f8263 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1095.619213] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1095.619467] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.619593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.619672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.619870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.620044] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.620150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.620198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.620330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.620438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.620538] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.680685] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 in Status: SUCCESS [ 1095.681017] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 deletion is rescheduled due to dependency. [ 1095.681305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.906361] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c29d6f-7489-45e1-8183-08f2d7095d33: rpc.has_security_group_logging(os_id): False [ 1095.924400] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.924763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.924862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.925134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.925272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.925516] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.925659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.925772] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.926011] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.926144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.926386] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.926523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.926616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.926873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.926990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.927317] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.927520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.927672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.927951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.928099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.928225] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1095.980494] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.980704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.980704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.980900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.981099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.008306] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1096.031422] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.031658] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.031760] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.032062] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.032336] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.032499] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.032620] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.032847] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.033009] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.033428] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.033551] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.033671] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.033790] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.033910] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1096.034030] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.034177] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.052322] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.052506] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1096.052655] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.052844] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.053213] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-bfb770ef-f537-4842-b8a2-750c76883a28 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.053412] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-bfb770ef-f537-4842-b8a2-750c76883a28" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.053541] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-bfb770ef-f537-4842-b8a2-750c76883a28" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.053894] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-bfb770ef-f537-4842-b8a2-750c76883a28" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.054052] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfb770ef-f537-4842-b8a2-750c76883a28',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.093394] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.123085] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.123242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.123342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.123569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.142953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.143245] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.143368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.143435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.143655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.143740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.143840] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1096.170378] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.170515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.170586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.170803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.171062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.181213] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1096.556341] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.556887] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.556887] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.557503] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.557503] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.557614] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port bfb770ef-f537-4842-b8a2-750c76883a28 not found, creating... [ 1096.557939] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.558178] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.558337] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.558633] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.558836] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.559207] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.559806] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.559806] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.559902] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.560151] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.560236] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: bfb770ef-f537-4842-b8a2-750c76883a28 is going to be created. [ 1096.579448] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.579670] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.579822] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.580139] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.580403] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.580657] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-bfb770ef-f537-4842-b8a2-750c76883a28" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.596688] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.597015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.597112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.597344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.597441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.597545] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1096.632769] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.632995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.632995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.633206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.633349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.654780] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1097.294380] env[63014]: INFO networking_nsxv3.common.synchronization [req-2388f785-a117-4174-828d-be1c83dbbe1c req-9fe44b51-3b3e-4826-92f8-9fb57bb0b3fc service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 1097.294695] env[63014]: INFO networking_nsxv3.common.synchronization [req-2388f785-a117-4174-828d-be1c83dbbe1c req-9fe44b51-3b3e-4826-92f8-9fb57bb0b3fc service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1097.294695] env[63014]: INFO networking_nsxv3.common.synchronization [req-2388f785-a117-4174-828d-be1c83dbbe1c req-9fe44b51-3b3e-4826-92f8-9fb57bb0b3fc service nova] Enqueued Resource ID: bfb770ef-f537-4842-b8a2-750c76883a28 with Priority: HIGHEST for action port [ 1097.294962] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 1097.296026] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1097.296026] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfb770ef-f537-4842-b8a2-750c76883a28 with Priority: HIGHEST for action port [ 1097.296026] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.296026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.296026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.296290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.296290] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.297199] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.297268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.297447] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfb770ef-f537-4842-b8a2-750c76883a28 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.297546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfb770ef-f537-4842-b8a2-750c76883a28" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.297609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfb770ef-f537-4842-b8a2-750c76883a28" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.297774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfb770ef-f537-4842-b8a2-750c76883a28" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.297849] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfb770ef-f537-4842-b8a2-750c76883a28',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.733171] env[63014]: INFO networking_nsxv3.common.synchronization [req-06a2bdb1-ed50-472a-ba7c-e1a3fba1c754 req-dc078deb-3822-4951-b345-88c1e6d72277 tempest-ImagesOneServerTestJSON-1912202909 tempest-ImagesOneServerTestJSON-1912202909-project-member] Enqueued Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGHEST for action security_group_members [ 1097.733807] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGHEST for action security_group_members [ 1097.734137] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-f994c7a5-b3ac-4a57-b55b-a769c6119282 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.734308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.734343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.734618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.734795] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.734906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.734969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.735599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.735599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.735599] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.799948] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.800088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.800321] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfb770ef-f537-4842-b8a2-750c76883a28 with status ACTIVE [ 1097.800439] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.800555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.800622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.800828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.800915] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.801098] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.801198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.801288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.801403] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.801477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.801647] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.801740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.801795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.801933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.802015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.802103] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfb770ef-f537-4842-b8a2-750c76883a28 is going to be updated. [ 1097.823791] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.823960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.823960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.824675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.824675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.824675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfb770ef-f537-4842-b8a2-750c76883a28" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.025400] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1098.025400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.038987] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.039214] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-252" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.039364] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-252" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.039689] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-252" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.039959] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.040135] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.040257] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.040481] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.040630] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.040888] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.044559] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1098.044788] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1098.044936] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1098.045079] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1098.045198] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1098.045340] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1098.060830] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1098.061043] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1098.061167] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1098.061352] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-252" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.061666] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-46ce6a8f-5e4e-40b3-be42-58256155a8d6 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.061841] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-46ce6a8f-5e4e-40b3-be42-58256155a8d6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.061970] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-46ce6a8f-5e4e-40b3-be42-58256155a8d6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.063118] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-46ce6a8f-5e4e-40b3-be42-58256155a8d6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.063118] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46ce6a8f-5e4e-40b3-be42-58256155a8d6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.192014] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1098.192014] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 deletion is rescheduled due to dependency. [ 1098.192014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.192014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.192014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.192014] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.192014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.192338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.192338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.192397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.192490] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.237468] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.237644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.237725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.237925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.238042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.238259] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.238358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.238416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.238574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.238662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.238773] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 already deleted. [ 1098.238862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.565228] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.565607] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.565607] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.565788] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.566026] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.567367] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 46ce6a8f-5e4e-40b3-be42-58256155a8d6 not found, creating... [ 1098.567367] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.567367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.567367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.567367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.567367] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.567652] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.567652] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.567768] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.569857] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.569857] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.569857] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 46ce6a8f-5e4e-40b3-be42-58256155a8d6 is going to be created. [ 1098.590507] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.590710] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.590851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.591166] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.591500] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.591872] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-46ce6a8f-5e4e-40b3-be42-58256155a8d6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.663788] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1098.664123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.664305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.664525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.664762] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.664928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.665035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.665250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.665338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.665446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.665541] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.694470] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.167780] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.167974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.168057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.168278] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.168439] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.168531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.168592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.168735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.168823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.168899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.169052] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.169140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.169196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.169333] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.169459] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.169542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.169598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.169728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.169798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.169874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.169961] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.196507] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.381446] env[63014]: INFO networking_nsxv3.common.synchronization [req-06a2bdb1-ed50-472a-ba7c-e1a3fba1c754 req-040653ce-6344-4187-9238-7a7b4c7ba4ba service nova] Enqueued Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGHEST for action security_group_rules [ 1099.381446] env[63014]: INFO networking_nsxv3.common.synchronization [req-06a2bdb1-ed50-472a-ba7c-e1a3fba1c754 req-040653ce-6344-4187-9238-7a7b4c7ba4ba service nova] Enqueued Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGHEST for action security_group_members [ 1099.381646] env[63014]: INFO networking_nsxv3.common.synchronization [req-06a2bdb1-ed50-472a-ba7c-e1a3fba1c754 req-040653ce-6344-4187-9238-7a7b4c7ba4ba service nova] Enqueued Resource ID: 46ce6a8f-5e4e-40b3-be42-58256155a8d6 with Priority: HIGHEST for action port [ 1099.382389] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGHEST for action security_group_rules [ 1099.382633] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGHEST for action security_group_members [ 1099.382812] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46ce6a8f-5e4e-40b3-be42-58256155a8d6 with Priority: HIGHEST for action port [ 1099.383260] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f994c7a5-b3ac-4a57-b55b-a769c6119282 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.383442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.383560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.383899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.384014] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.384953] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-f994c7a5-b3ac-4a57-b55b-a769c6119282 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.385106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.385186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.385415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.385577] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.385696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.385769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.385923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.386041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.386132] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.386987] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-46ce6a8f-5e4e-40b3-be42-58256155a8d6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.387109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46ce6a8f-5e4e-40b3-be42-58256155a8d6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.387175] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46ce6a8f-5e4e-40b3-be42-58256155a8d6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.387452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46ce6a8f-5e4e-40b3-be42-58256155a8d6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.387452] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46ce6a8f-5e4e-40b3-be42-58256155a8d6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.672141] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b49a7f5-6ed4-481f-81ba-d9ed36714c01: rpc.has_security_group_logging(os_id): False [ 1099.690563] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.690743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.690781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.690978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.691083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.691294] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.691386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.691450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.691595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.691668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.691857] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.691988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.692078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.692247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.692340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.692568] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.692672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.692765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.692949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.693057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.693145] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1099.699915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.700049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.700152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.700286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.700373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.700464] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1099.732446] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.732598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.732718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.732864] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.733015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.741369] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1099.756321] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.756462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.756530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.756846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.757075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.772031] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1099.889347] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.890426] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-f994c7a5-b3ac-4a57-b55b-a769c6119282 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.890579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.891579] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46ce6a8f-5e4e-40b3-be42-58256155a8d6 with status ACTIVE [ 1099.891672] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.891735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.891803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.892030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.892132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.892359] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.892442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.892486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.892612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.892692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.893198] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.893198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.893198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.893198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.893379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.893379] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46ce6a8f-5e4e-40b3-be42-58256155a8d6 is going to be updated. [ 1099.925995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.926538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.926619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.926867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.927039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.927222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46ce6a8f-5e4e-40b3-be42-58256155a8d6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.392792] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.759604] env[63014]: INFO networking_nsxv3.common.synchronization [req-212f2b26-cf55-4cd8-a345-23f074ca66bd req-3fd1218a-4afc-497f-b61d-3b0c350a7066 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1100.761906] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1100.762104] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.762104] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.762208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.762361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.762514] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.762642] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.762711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.762868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.762947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.763052] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.894828] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.895052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.895052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.895315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.895392] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.895495] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 is going to be created. [ 1100.917157] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.917336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.917423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.917675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.917862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.927392] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 in Status: UNINITIALIZED for 2s [ 1101.268035] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.750978] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1101.751296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.751534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.751919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.752239] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.752438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.752536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.752718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.752804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.752895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.752992] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.770973] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.784076] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1101.784523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.203440] env[63014]: INFO networking_nsxv3.common.synchronization [None req-cae8c692-4d17-4942-aa01-393b82ae2fae tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1102.203975] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1102.204329] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.204461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.204529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.204730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.204906] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.210884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.211033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.211241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.211338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.211453] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.256071] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.257117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.273238] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.273446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.273481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.273691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.273788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.273899] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1102.300395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.300550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.300610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.300807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.300950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.309051] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1102.713682] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.939047] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 in Status: SUCCESS [ 1102.939352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.939352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.939516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.939709] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.939823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.939940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.940063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.940147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.940236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.940325] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.216162] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.442252] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-f994c7a5-b3ac-4a57-b55b-a769c6119282 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.442426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.442550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.442848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.443283] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.443438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.443523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.443738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.443834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.443928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.444166] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-f994c7a5-b3ac-4a57-b55b-a769c6119282 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.444276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.444339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.444488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.444631] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.444724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.444843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.444917] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.444999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.445814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.445955] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.719076] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.719076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.719310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.719412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.719532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.719646] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1103.749857] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.750088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.750088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.750342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.750498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.759802] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1103.948223] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f994c7a5-b3ac-4a57-b55b-a769c6119282: rpc.has_security_group_logging(os_id): False [ 1103.964565] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.964703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.964780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.964998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.965103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.965328] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.965425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.965488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.965634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.965710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.965882] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.965975] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.966046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.966188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.966263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.966438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.967058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.967058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.967058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.967058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.967058] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 is going to be created. [ 1104.016612] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.016935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.016935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.017087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.017359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.027989] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 in Status: IN_PROGRESS for 2s [ 1104.294090] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.294329] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.294477] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.294788] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.295194] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.295394] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.295544] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.295798] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.297252] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.297563] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.297770] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.297970] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.298423] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.299887] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1104.299887] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.299887] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.319275] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.319427] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1104.319572] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.319751] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.320084] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-abbde201-ca89-4857-9ce1-2b2a7795df86 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.320260] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-abbde201-ca89-4857-9ce1-2b2a7795df86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.320383] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-abbde201-ca89-4857-9ce1-2b2a7795df86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.320704] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-abbde201-ca89-4857-9ce1-2b2a7795df86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.320848] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abbde201-ca89-4857-9ce1-2b2a7795df86',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.322218] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1104.322412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.824043] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.824335] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.824560] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.824896] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.825193] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.825409] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port abbde201-ca89-4857-9ce1-2b2a7795df86 not found, creating... [ 1104.825733] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.825971] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.826123] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.826378] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.826588] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.826972] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.827208] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.827364] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.827623] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.827809] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.827999] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: abbde201-ca89-4857-9ce1-2b2a7795df86 is going to be created. [ 1104.846845] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.847100] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.847241] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.847489] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.848045] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.848045] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-abbde201-ca89-4857-9ce1-2b2a7795df86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.544393] env[63014]: INFO networking_nsxv3.common.synchronization [req-8513192e-ef44-4ac1-b858-7c65aefd6025 req-1b7aafc8-7afb-4e2e-ab84-b035385a82b8 service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 1105.544673] env[63014]: INFO networking_nsxv3.common.synchronization [req-8513192e-ef44-4ac1-b858-7c65aefd6025 req-1b7aafc8-7afb-4e2e-ab84-b035385a82b8 service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1105.544884] env[63014]: INFO networking_nsxv3.common.synchronization [req-8513192e-ef44-4ac1-b858-7c65aefd6025 req-1b7aafc8-7afb-4e2e-ab84-b035385a82b8 service nova] Enqueued Resource ID: abbde201-ca89-4857-9ce1-2b2a7795df86 with Priority: HIGHEST for action port [ 1105.545578] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 1105.545783] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1105.545909] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abbde201-ca89-4857-9ce1-2b2a7795df86 with Priority: HIGHEST for action port [ 1105.547019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.547019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.547019] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.547019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.547243] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-abbde201-ca89-4857-9ce1-2b2a7795df86 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.547381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abbde201-ca89-4857-9ce1-2b2a7795df86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.547470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abbde201-ca89-4857-9ce1-2b2a7795df86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.547744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abbde201-ca89-4857-9ce1-2b2a7795df86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.547863] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abbde201-ca89-4857-9ce1-2b2a7795df86',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.769137] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1105.769444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.769636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.769901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.770148] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.770291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.770362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.770550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.770639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.770748] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.770933] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.771053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.771118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.771290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.771485] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.771590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.771671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.771826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.771911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.772024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.772121] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.772983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.773185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.773362] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.773470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.773547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.773698] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.773783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.773888] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.038804] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 in Status: SUCCESS [ 1106.039065] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.051081] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port abbde201-ca89-4857-9ce1-2b2a7795df86 with status ACTIVE [ 1106.051434] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.051643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.051643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.051889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.051950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.052199] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.052285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.052340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.052476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.052573] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.052805] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.052916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.052979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.053264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.053264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.053411] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: abbde201-ca89-4857-9ce1-2b2a7795df86 is going to be updated. [ 1106.072841] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.073093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.073093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.073273] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.073412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.073574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abbde201-ca89-4857-9ce1-2b2a7795df86" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.275473] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7e639c-697c-438d-b550-983a53fa2d55: rpc.has_security_group_logging(os_id): False [ 1106.276735] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.296349] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.296501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.296572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.297327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.297327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.297327] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.297327] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.297606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.297606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.297672] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.297857] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.298000] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.298071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.298183] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.298263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.298449] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.298545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.298607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.298801] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.298888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.298977] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1106.365999] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.366198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.366259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.366478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.366625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.382272] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1106.779581] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.284946] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.285143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.285206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.285421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.285514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.285617] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1107.320215] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.320412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.320412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.320650] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.320804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.331487] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1108.395897] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1108.396226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.396226] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.396341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.396428] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.898432] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.898593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.340595] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1109.340766] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.340878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.341123] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.341317] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.341432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.341489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.341644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.341728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.341814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.341899] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.845137] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.845137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.845137] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.845607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.845607] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.845607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.845706] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.845876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.846043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.846164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.846341] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.846458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.846515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.846715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.846949] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.847198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.847198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.847373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.847514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.847660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.847798] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.350430] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7e639c-697c-438d-b550-983a53fa2d55: rpc.has_security_group_logging(os_id): False [ 1110.367230] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.367422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.367494] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.367712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.367808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.368011] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.368147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.368349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.368349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.368456] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.369099] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.369099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.369099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.369099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.369436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.369691] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.369691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.369914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.369914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.369970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.370062] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1110.426840] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.427320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.427320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.427320] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.427477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.441678] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1110.546785] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1110.546785] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1110.755391] env[63014]: INFO networking_nsxv3.common.synchronization [req-f6ffaed4-970f-42b5-a9e9-9076ca605d9d req-db89e68c-89eb-49a3-9240-9e7fe490f908 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1110.755993] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1110.756689] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.756689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.756689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.756904] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.757585] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.757585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.757585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.757776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.757937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.757937] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.075982] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.075982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.075982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.075982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.076644] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.076961] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.077227] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.077612] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.077878] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.078776] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.078776] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.078776] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.078776] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.078776] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1111.078776] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.079203] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.096886] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.097153] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1111.097325] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.097527] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.097854] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-98c6fa53-6bfc-49af-9583-88bc273278d3 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.098128] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-98c6fa53-6bfc-49af-9583-88bc273278d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.098274] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-98c6fa53-6bfc-49af-9583-88bc273278d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.098613] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-98c6fa53-6bfc-49af-9583-88bc273278d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.098752] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c6fa53-6bfc-49af-9583-88bc273278d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.261422] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.601889] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.601889] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.601889] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.602229] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.602270] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.602447] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 98c6fa53-6bfc-49af-9583-88bc273278d3 not found, creating... [ 1111.602804] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.603032] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.603276] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.603521] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.603723] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.604099] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.604319] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.604472] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.604748] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.604924] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.605125] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 98c6fa53-6bfc-49af-9583-88bc273278d3 is going to be created. [ 1111.627155] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.627545] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.627776] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.628213] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.628615] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.628895] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-98c6fa53-6bfc-49af-9583-88bc273278d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.764419] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.269706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.270065] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.270065] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.270204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.270204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.270395] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1112.296016] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.296245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.296347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.296616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.296825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.309222] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1112.320362] env[63014]: INFO networking_nsxv3.common.synchronization [req-f6ffaed4-970f-42b5-a9e9-9076ca605d9d req-4c240b85-8566-4168-96ec-c91bd0996d95 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1112.320598] env[63014]: INFO networking_nsxv3.common.synchronization [req-f6ffaed4-970f-42b5-a9e9-9076ca605d9d req-4c240b85-8566-4168-96ec-c91bd0996d95 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1112.320762] env[63014]: INFO networking_nsxv3.common.synchronization [req-f6ffaed4-970f-42b5-a9e9-9076ca605d9d req-4c240b85-8566-4168-96ec-c91bd0996d95 service nova] Enqueued Resource ID: 98c6fa53-6bfc-49af-9583-88bc273278d3 with Priority: HIGHEST for action port [ 1112.321706] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1112.321855] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1112.321979] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c6fa53-6bfc-49af-9583-88bc273278d3 with Priority: HIGHEST for action port [ 1112.322298] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.322619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.322712] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.322972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.323039] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.323930] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.324035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.324603] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-98c6fa53-6bfc-49af-9583-88bc273278d3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.324735] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98c6fa53-6bfc-49af-9583-88bc273278d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.324817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98c6fa53-6bfc-49af-9583-88bc273278d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.324985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98c6fa53-6bfc-49af-9583-88bc273278d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.325067] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98c6fa53-6bfc-49af-9583-88bc273278d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.455912] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1112.456091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.827066] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.827326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.827394] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98c6fa53-6bfc-49af-9583-88bc273278d3 with status ACTIVE [ 1112.827572] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.827679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.827737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.827954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.828058] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.828296] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.828435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.828497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.828675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.828764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.828955] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.829362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.829362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.829362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.829362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.829580] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98c6fa53-6bfc-49af-9583-88bc273278d3 is going to be updated. [ 1112.850677] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.850922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.851015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.851233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.851442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.851668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98c6fa53-6bfc-49af-9583-88bc273278d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.310497] env[63014]: INFO networking_nsxv3.common.synchronization [req-832d6816-7309-4e12-b8eb-b6b6f735e179 req-8aa777e8-3196-45cd-8f06-dcc9bdd61fc2 tempest-ServerActionsTestOtherB-7425835 tempest-ServerActionsTestOtherB-7425835-project-member] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1113.311436] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1113.311436] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.311596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.311596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.311778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.311890] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.311990] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.312061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.312212] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.313042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.313042] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.815811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.815811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.815811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.816036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.816177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.816427] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.816538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.816600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.816773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.816855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.816947] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1113.848271] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.848271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.848271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.848581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.848581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.857688] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1114.318835] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1114.319293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.319293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.319560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.319762] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.319896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.319963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.320152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.320258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.320368] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.822518] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.325469] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.829081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.829343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.829343] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.829559] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.829662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.829767] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1115.861580] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.861580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.861580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.861580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.861580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.871793] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1115.871793] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1115.871793] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 deletion is rescheduled due to dependency. [ 1115.871793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.848702] env[63014]: INFO networking_nsxv3.common.synchronization [req-ec8939aa-8674-4d86-b84e-dc73167eddbb req-5e7da5bb-6c54-49fd-96a4-1ea83d46782f tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1117.849486] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1117.849893] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.852060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.852060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.852060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.852060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.852060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.852060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.852506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.852506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.852506] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.885186] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1117.885347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.886087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.886258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.886464] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.886570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.886635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.886795] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.886876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.886963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.887066] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.357657] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.389636] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.389636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.389941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.389994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.390154] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.390282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.390346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.390652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.390754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.390866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.391060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.391146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.391222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.391373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.391529] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.391622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.391680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.391836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.391911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.391992] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.392120] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.860427] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.893811] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c29d6f-7489-45e1-8183-08f2d7095d33: rpc.has_security_group_logging(os_id): False [ 1118.911513] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.911669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.911762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.912079] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.912374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.912427] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.912515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.912613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.912791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.912894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.913134] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.913265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.913347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.913511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.913584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.913767] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.913872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.913935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.914097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.914172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.914282] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1118.966250] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.966250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.966250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.966250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.966250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.985861] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1119.078528] env[63014]: INFO networking_nsxv3.common.synchronization [None req-de30ea90-cb46-486b-ba9d-ee8952f66764 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1119.079158] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1119.080040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.080040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.362524] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.362721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.362721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.363040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.363188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.363325] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1119.390552] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.390552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.390552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.390834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.390868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.398896] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1121.000890] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1121.002103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.408685] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1121.408919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.409108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.409330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.409510] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.409652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.409697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.409899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.409960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.410416] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.879975] env[63014]: INFO networking_nsxv3.common.synchronization [req-4c55d1a7-da44-42c0-a254-6ab1bced433a req-ad7a72ac-b252-49ff-9be0-483446887050 tempest-ServerActionsTestOtherB-7425835 tempest-ServerActionsTestOtherB-7425835-project-member] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1121.879975] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1121.880490] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.880490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.880490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.880674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.880845] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.880914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.880969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.881131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.881215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.881306] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.913338] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.913574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.913648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.913873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.913963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.914175] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.914277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.914335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.914507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.914630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.914731] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1121.940050] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.940192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.940229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.940551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.940812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.951935] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1122.227489] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.227797] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.227852] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.228121] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.228395] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.228574] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.228702] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.228938] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.229101] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.229311] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.229430] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.229542] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.229685] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.229786] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.229870] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.230012] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.248594] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.248765] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1122.248909] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.249090] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.249381] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-13f8614e-ef44-4977-94ec-74450b5ddc1c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.249547] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-13f8614e-ef44-4977-94ec-74450b5ddc1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.249668] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-13f8614e-ef44-4977-94ec-74450b5ddc1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.250011] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-13f8614e-ef44-4977-94ec-74450b5ddc1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.250162] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13f8614e-ef44-4977-94ec-74450b5ddc1c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.384898] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.384898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.384898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.384898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.384898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.384898] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.385359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.385359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.385359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.385359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.385479] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1122.410366] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.410576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.410620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.410832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.410987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.419083] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1122.753225] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.753225] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.753225] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.753564] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.754057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.754057] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 13f8614e-ef44-4977-94ec-74450b5ddc1c not found, creating... [ 1122.754057] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.754256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.754360] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.754593] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.754739] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.755062] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.755254] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.755392] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.755612] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.755762] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.755909] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 13f8614e-ef44-4977-94ec-74450b5ddc1c is going to be created. [ 1122.774408] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.774632] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.774734] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.775205] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.775268] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.775446] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-13f8614e-ef44-4977-94ec-74450b5ddc1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.526934] env[63014]: INFO networking_nsxv3.common.synchronization [req-4c55d1a7-da44-42c0-a254-6ab1bced433a req-89fb0634-265d-45e9-a334-3c375d6e3957 service nova] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 1123.527233] env[63014]: INFO networking_nsxv3.common.synchronization [req-4c55d1a7-da44-42c0-a254-6ab1bced433a req-89fb0634-265d-45e9-a334-3c375d6e3957 service nova] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1123.527284] env[63014]: INFO networking_nsxv3.common.synchronization [req-4c55d1a7-da44-42c0-a254-6ab1bced433a req-89fb0634-265d-45e9-a334-3c375d6e3957 service nova] Enqueued Resource ID: 13f8614e-ef44-4977-94ec-74450b5ddc1c with Priority: HIGHEST for action port [ 1123.527815] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 1123.527953] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1123.528062] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13f8614e-ef44-4977-94ec-74450b5ddc1c with Priority: HIGHEST for action port [ 1123.528652] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.528834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.528906] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.529116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.529201] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.530389] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.530531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.530742] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-13f8614e-ef44-4977-94ec-74450b5ddc1c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.530852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13f8614e-ef44-4977-94ec-74450b5ddc1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.530922] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13f8614e-ef44-4977-94ec-74450b5ddc1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.531106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13f8614e-ef44-4977-94ec-74450b5ddc1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.531182] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13f8614e-ef44-4977-94ec-74450b5ddc1c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.961719] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1123.961719] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 deletion is rescheduled due to dependency. [ 1123.961719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.035166] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13f8614e-ef44-4977-94ec-74450b5ddc1c with status ACTIVE [ 1124.035451] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.035592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.035661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.035885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.035977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.036186] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.036286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.036348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.036512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.036595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.036776] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.036879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.036923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.037087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.037163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.037247] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13f8614e-ef44-4977-94ec-74450b5ddc1c is going to be updated. [ 1124.038441] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.038543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.056872] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.056984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.057055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.057258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.057462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.057631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13f8614e-ef44-4977-94ec-74450b5ddc1c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.427882] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1124.428086] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 deletion is rescheduled due to dependency. [ 1124.428967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.429191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.429428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.429621] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.429790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.429873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.430064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.430153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.430252] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.932400] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.434778] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.937185] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.937635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.937635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.937761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.938016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.938168] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1125.981668] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.981803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.981884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.982091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.982233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.990613] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1126.908546] env[63014]: INFO networking_nsxv3.common.synchronization [req-c772801c-b4b5-4311-8cf6-a01e6e36afd8 req-b6f84e37-beaf-4c42-bcf4-21420cb6be58 tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1126.908546] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1126.908546] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.908546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.908546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.908546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.908546] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.908832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.908832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.908888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.909000] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.909108] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.997604] env[63014]: INFO networking_nsxv3.common.synchronization [req-ba41be98-e67c-46ae-a9e4-514a692dc001 req-baeb4774-9b6d-4c1c-830c-8ad3801009f6 tempest-AttachVolumeShelveTestJSON-960433482 tempest-AttachVolumeShelveTestJSON-960433482-project-member] Enqueued Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_members [ 1126.998183] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 with Priority: HIGHEST for action security_group_members [ 1126.998478] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f73f976-0a71-450e-b4d0-b6746ce641e7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.998619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.998701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.999418] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.999652] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.000854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.000979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.002597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.002597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.002597] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f73f976-0a71-450e-b4d0-b6746ce641e7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.331738] env[63014]: INFO networking_nsxv3.common.synchronization [req-11f0eda5-5ae9-4c6c-a1db-8ed65e121e4e req-4df418e3-22bd-4884-8bb9-aa9a7c70e4e5 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1127.332843] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1127.333313] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.333514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.333724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.334960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.335347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.335538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.335692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.335965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.336094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.336247] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.415880] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.416312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.416539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.416969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.419054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.419548] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.420653] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.420734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.421189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.421304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.421423] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1127.447049] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.447049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.447049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.447049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.447769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.457320] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1127.507940] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.508611] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.508722] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.508959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.509112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.509320] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.509428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.509580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.509701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.509805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.510182] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 is going to be updated. [ 1127.534912] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.535188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.535289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.535543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.535682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.546481] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: IN_PROGRESS for 2s [ 1127.839509] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.839674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.839747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.839974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.840083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.840286] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.840700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.840700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.840700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.840700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.840887] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1127.843333] env[63014]: INFO networking_nsxv3.common.synchronization [req-865546f3-10cb-48c3-911c-df830e41474b req-c3947c9e-6db8-4441-901a-cf0269ffe427 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_members [ 1127.844055] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGHEST for action security_group_members [ 1127.844564] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-de490883-41da-4c7f-bed6-8ce11a434e5c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.844678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.844763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.844889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.845043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.845139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.845194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.845357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.845428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.845516] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.883313] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.883313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.883313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.883313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.883313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.899015] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1128.000620] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1128.000933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.001017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.001255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.001440] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.002030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.002030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.002030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.002030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.002030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.002030] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.351466] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.351645] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.351686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.351891] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.372860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.373633] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.373633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.373633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.373791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.373858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.373956] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de490883-41da-4c7f-bed6-8ce11a434e5c is going to be updated. [ 1128.398253] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.398480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.398480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.398736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.398925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.408378] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de490883-41da-4c7f-bed6-8ce11a434e5c in Status: IN_PROGRESS for 2s [ 1128.505520] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.790867] env[63014]: INFO networking_nsxv3.common.synchronization [req-f5f42bfe-b0e2-4d80-9518-820c0535d18a req-859fdd2b-40c2-4fbf-a2b0-4a6381ffd328 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1128.791412] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1128.791719] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.793064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.793064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.793064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.793064] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.793064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.793064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.793064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.793064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.793064] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.007796] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db110989-027c-4ed8-b5db-6b256912c344: rpc.has_security_group_logging(os_id): False [ 1129.029147] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.029147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.029147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.029147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.029147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.029147] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.029147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.029147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.029147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.029147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.029147] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1129.101143] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.101369] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.101508] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.101845] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.102341] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.102544] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.102714] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.103010] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.103303] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.103539] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.103718] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.103871] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.103960] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.104097] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1129.104221] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.104346] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.117100] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.117241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.117414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.118358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.118358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.124391] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.124530] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1129.124674] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.124845] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.125164] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.125342] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.125511] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.125836] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.125973] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e9c3de-a281-41ff-8a55-cb6c7537f6ae',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.132984] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1129.295928] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.467937] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1129.468124] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1129.468267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.554420] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 in Status: SUCCESS [ 1129.554613] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f73f976-0a71-450e-b4d0-b6746ce641e7 deletion is rescheduled due to dependency. [ 1129.554730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f73f976-0a71-450e-b4d0-b6746ce641e7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.628400] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.628400] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.628691] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.628828] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.628988] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.629198] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 13e9c3de-a281-41ff-8a55-cb6c7537f6ae not found, creating... [ 1129.629502] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.629687] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.629890] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.630144] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.630332] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.630649] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.630851] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.630994] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.631322] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.632036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.632036] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 13e9c3de-a281-41ff-8a55-cb6c7537f6ae is going to be created. [ 1129.652596] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.652837] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.652981] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.653323] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.653614] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.653958] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.797887] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.908076] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1129.908343] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 1129.908407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.303060] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.303060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.303060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.303060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.303060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.303060] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1130.331695] env[63014]: INFO networking_nsxv3.common.synchronization [req-f5f42bfe-b0e2-4d80-9518-820c0535d18a req-dbd03fa0-fbc3-46e1-8dfe-b31a93f3afe1 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1130.331839] env[63014]: INFO networking_nsxv3.common.synchronization [req-f5f42bfe-b0e2-4d80-9518-820c0535d18a req-dbd03fa0-fbc3-46e1-8dfe-b31a93f3afe1 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1130.331981] env[63014]: INFO networking_nsxv3.common.synchronization [req-f5f42bfe-b0e2-4d80-9518-820c0535d18a req-dbd03fa0-fbc3-46e1-8dfe-b31a93f3afe1 service nova] Enqueued Resource ID: 13e9c3de-a281-41ff-8a55-cb6c7537f6ae with Priority: HIGHEST for action port [ 1130.335158] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.335302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.335302] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.335509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.336821] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.336821] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1130.336821] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1130.337139] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e9c3de-a281-41ff-8a55-cb6c7537f6ae with Priority: HIGHEST for action port [ 1130.337521] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.337872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.337872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.337872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.338038] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.338802] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.338898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.339461] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.339571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.339635] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.339805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.339877] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e9c3de-a281-41ff-8a55-cb6c7537f6ae',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.347767] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1130.420797] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de490883-41da-4c7f-bed6-8ce11a434e5c in Status: SUCCESS [ 1130.420797] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de490883-41da-4c7f-bed6-8ce11a434e5c deletion is rescheduled due to dependency. [ 1130.420934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.842493] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.842636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.843163] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13e9c3de-a281-41ff-8a55-cb6c7537f6ae with status ACTIVE [ 1130.843163] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.843163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.843163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.843531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.843531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.843628] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.843889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.844818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.844818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.844818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.844818] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.844818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.844818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.844818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.844818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.844818] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13e9c3de-a281-41ff-8a55-cb6c7537f6ae is going to be updated. [ 1130.864146] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.864303] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.864366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.864520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.864651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.864803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13e9c3de-a281-41ff-8a55-cb6c7537f6ae" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.074204] env[63014]: INFO networking_nsxv3.common.synchronization [req-89af0c7e-b92b-414c-b376-6b086451775c req-0bc0445e-6340-4fcb-a98f-78b36bfce862 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1131.074756] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1131.075094] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.075251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.075321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.075596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.075875] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.075989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.076050] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.076202] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.076282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.076372] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.145504] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1131.145734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.327208] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-684 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.327550] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.327596] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.327887] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.328175] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.328338] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.328460] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.328698] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.328847] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.329068] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.329186] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1131.329298] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1131.329410] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1131.329639] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1131.329639] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1131.329766] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1131.348924] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1131.349121] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1131.349268] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1131.349451] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-684" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.349773] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-bc77ea70-1a79-4a08-93e0-516b047d45f1 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.349974] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-bc77ea70-1a79-4a08-93e0-516b047d45f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.350120] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-bc77ea70-1a79-4a08-93e0-516b047d45f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.350438] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-bc77ea70-1a79-4a08-93e0-516b047d45f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.350584] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc77ea70-1a79-4a08-93e0-516b047d45f1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.579759] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.579759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.579759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.580423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.580423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.580645] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.580776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.580895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.581097] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.581495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.581620] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1131.607532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.607670] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.607734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.608262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.608262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.616165] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1131.854519] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.854519] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.854755] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.854917] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.855087] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.855250] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port bc77ea70-1a79-4a08-93e0-516b047d45f1 not found, creating... [ 1131.855510] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.855667] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.855795] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.856027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.856178] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.856459] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.856621] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.856744] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.856959] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.857186] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.857337] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: bc77ea70-1a79-4a08-93e0-516b047d45f1 is going to be created. [ 1131.875799] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.875997] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.876151] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.876412] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.876639] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.876860] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-bc77ea70-1a79-4a08-93e0-516b047d45f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.356684] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1132.357028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.357088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.357309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.357524] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.357657] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.357725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.357894] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.357980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.358090] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.658372] env[63014]: INFO networking_nsxv3.common.synchronization [req-89af0c7e-b92b-414c-b376-6b086451775c req-367c5753-40d3-4c7f-9717-3b3969743fee service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 1132.658506] env[63014]: INFO networking_nsxv3.common.synchronization [req-89af0c7e-b92b-414c-b376-6b086451775c req-367c5753-40d3-4c7f-9717-3b3969743fee service nova] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1132.658996] env[63014]: INFO networking_nsxv3.common.synchronization [req-89af0c7e-b92b-414c-b376-6b086451775c req-367c5753-40d3-4c7f-9717-3b3969743fee service nova] Enqueued Resource ID: bc77ea70-1a79-4a08-93e0-516b047d45f1 with Priority: HIGHEST for action port [ 1132.659661] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_rules [ 1132.659820] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1132.659945] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc77ea70-1a79-4a08-93e0-516b047d45f1 with Priority: HIGHEST for action port [ 1132.660278] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.660416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.660486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.660665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.660744] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.661893] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.661893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.662085] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc77ea70-1a79-4a08-93e0-516b047d45f1 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.662085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc77ea70-1a79-4a08-93e0-516b047d45f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.662085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc77ea70-1a79-4a08-93e0-516b047d45f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.662325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc77ea70-1a79-4a08-93e0-516b047d45f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.662325] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc77ea70-1a79-4a08-93e0-516b047d45f1',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.860136] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.164848] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.164977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.165198] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc77ea70-1a79-4a08-93e0-516b047d45f1 with status ACTIVE [ 1133.165376] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.165486] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.165542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.165764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.165855] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.166066] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.166165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.166225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.166378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.166458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.166639] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.166733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.166792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.166944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.167030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.167139] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc77ea70-1a79-4a08-93e0-516b047d45f1 is going to be updated. [ 1133.187135] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.187328] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.187417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.187667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.187825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.187989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc77ea70-1a79-4a08-93e0-516b047d45f1" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.362595] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.625505] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1133.625887] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 1133.626790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.627510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.627876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.628663] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.628663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.628663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.628663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.628663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.628663] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.869103] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.869299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.869299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.869510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.869604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.869706] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1133.900314] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.900461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.900531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.900822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.900879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.909136] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1134.131427] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.633575] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.136171] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.136353] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.136425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.136659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.136754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.136855] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1135.165738] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.165738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.165738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.165738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.165738] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.172054] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1135.918342] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1135.918733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.918733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.918979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.919154] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.919288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.919380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.919568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.919689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.919805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.919906] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.421952] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.422213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.422325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.422585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.422795] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.422936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.423035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.423230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.423345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.423442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.423621] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.423741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.423826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.423984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.424149] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.424246] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.424305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.424447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.424524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.424606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.424696] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.859518] env[63014]: INFO networking_nsxv3.common.synchronization [None req-eb7b9af7-fdd3-4225-a559-035dc0744602 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_rules [ 1136.860234] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_rules [ 1136.860582] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.860707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.860778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.861193] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.861261] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.927311] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c29d6f-7489-45e1-8183-08f2d7095d33: rpc.has_security_group_logging(os_id): False [ 1136.935048] env[63014]: INFO networking_nsxv3.common.synchronization [None req-c7766f1c-98b0-4366-8075-b2a92f46e5dd tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_rules [ 1136.935161] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_rules [ 1136.935403] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.935511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.947769] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.947945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.948025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.948265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.948348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.948548] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.948639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.948703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.948858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.948980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.949308] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.949481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.949481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.949620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.949695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.949893] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.950029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.950190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.950428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.950526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.950583] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1137.008259] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.008471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.008471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.008704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.008853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.030324] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1137.185312] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1137.185312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.185312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.185595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.185656] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.185782] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.185850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.186066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.186157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.186265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.186375] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.385635] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.385837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.385837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.386080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.386177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.386272] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f4789b-3196-4067-98ab-735a7770f947 already deleted. [ 1137.386355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.386512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.386673] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.386773] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.688500] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.688713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.688797] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.689040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.689225] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.689347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.689413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.689564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.689653] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.689744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.689910] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.690057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.690125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.690269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.690410] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.690506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.690581] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.690725] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.690803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.690885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.690973] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.908453] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.908718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.908788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.909083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.909204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.909313] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f4789b-3196-4067-98ab-735a7770f947 already deleted. [ 1137.909411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.194055] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b917177-fad2-4a8d-bb56-2b4d47acad21: rpc.has_security_group_logging(os_id): False [ 1138.212303] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.212466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.212536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.212788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.212912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.213163] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.213283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.213348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.213514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.213608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.213831] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.213968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.214084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.214272] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.214364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.214596] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.214711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.214910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.215094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.215222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.215322] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1138.249867] env[63014]: INFO networking_nsxv3.common.synchronization [req-9ec658d0-336b-40b8-a9de-95d2b41fb2bf req-e76726de-d7a3-4006-8669-1990fbc593fe tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1138.252831] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1138.252831] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.252831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.252831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.252831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.252831] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.252831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.252831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.252831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.252831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.252831] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.269812] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.269970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.270046] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.270252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.270462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.290602] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1138.754541] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.754714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.754770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.754982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.777445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.777995] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.777995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.778144] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.778369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.778460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.778561] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1138.805273] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.805472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.805577] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.805742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.805901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.816348] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1139.046384] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1139.046659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.279552] env[63014]: INFO networking_nsxv3.common.synchronization [req-eba6f27b-b6bb-46f0-9caa-20105f1f2716 req-bccd7e90-0aef-448e-b2c5-98b514ef8e7d tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1139.280152] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1139.280459] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.281695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.281695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.281695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.281695] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.281695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.281695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.281695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.281695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.281695] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.755406] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.755661] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.755772] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.756127] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.756443] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.756675] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.756855] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.757189] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.757387] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.757726] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.758623] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1139.759429] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1139.759429] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1139.759429] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1139.759429] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1139.759690] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1139.778097] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1139.778097] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1139.778097] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1139.778097] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.778097] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-0aa0d557-feef-4158-bf13-9f4cfb08a50c taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.778537] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-0aa0d557-feef-4158-bf13-9f4cfb08a50c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.778537] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-0aa0d557-feef-4158-bf13-9f4cfb08a50c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.778731] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-0aa0d557-feef-4158-bf13-9f4cfb08a50c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.778895] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aa0d557-feef-4158-bf13-9f4cfb08a50c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.784718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.784860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.784948] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.785257] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.785987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.785987] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.785987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.785987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.785987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.786292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.786292] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1139.809452] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.809646] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.809746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.810234] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.810427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.818514] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1140.283176] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.283176] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.283530] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.283637] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.283821] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.283999] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 0aa0d557-feef-4158-bf13-9f4cfb08a50c not found, creating... [ 1140.284310] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.284483] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.284629] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.284919] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.285086] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.285412] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.285623] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.285755] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.286090] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.286259] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.286435] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 0aa0d557-feef-4158-bf13-9f4cfb08a50c is going to be created. [ 1140.307504] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1140.307887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.309534] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.310819] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.310819] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.310819] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.310819] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.311121] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-0aa0d557-feef-4158-bf13-9f4cfb08a50c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.825257] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1140.825510] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c deletion is rescheduled due to dependency. [ 1140.825682] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.134021] env[63014]: INFO networking_nsxv3.common.synchronization [req-eba6f27b-b6bb-46f0-9caa-20105f1f2716 req-e17861b2-2555-4c5e-bf43-7753d811c74f service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1141.134021] env[63014]: INFO networking_nsxv3.common.synchronization [req-eba6f27b-b6bb-46f0-9caa-20105f1f2716 req-e17861b2-2555-4c5e-bf43-7753d811c74f service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1141.134021] env[63014]: INFO networking_nsxv3.common.synchronization [req-eba6f27b-b6bb-46f0-9caa-20105f1f2716 req-e17861b2-2555-4c5e-bf43-7753d811c74f service nova] Enqueued Resource ID: 0aa0d557-feef-4158-bf13-9f4cfb08a50c with Priority: HIGHEST for action port [ 1141.134021] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1141.134021] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1141.134021] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aa0d557-feef-4158-bf13-9f4cfb08a50c with Priority: HIGHEST for action port [ 1141.136271] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.136271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.136271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.136461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.136541] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.137329] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.137422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.137615] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aa0d557-feef-4158-bf13-9f4cfb08a50c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.137733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aa0d557-feef-4158-bf13-9f4cfb08a50c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.137825] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aa0d557-feef-4158-bf13-9f4cfb08a50c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.138009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aa0d557-feef-4158-bf13-9f4cfb08a50c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.138110] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aa0d557-feef-4158-bf13-9f4cfb08a50c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.401032] env[63014]: INFO networking_nsxv3.common.synchronization [req-4fd04574-d54a-49a8-ad07-fd6afe916b39 req-899bb7e6-f634-4347-bb7e-41bc90d9d2c1 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1141.401032] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1141.401380] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.401665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.401665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.401786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.401896] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.401979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.402041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.402207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.402304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.402511] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.640116] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.640341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.642565] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0aa0d557-feef-4158-bf13-9f4cfb08a50c with status ACTIVE [ 1141.642749] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.642895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.642935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.643198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.643249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.643415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.643513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.643780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.643780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.643780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.643955] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.644049] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.644162] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.644255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.644331] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.644418] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0aa0d557-feef-4158-bf13-9f4cfb08a50c is going to be updated. [ 1141.666610] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.666784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.666784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.667233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.667233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.667359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aa0d557-feef-4158-bf13-9f4cfb08a50c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.831166] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1141.831166] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1141.831166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.831166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.831166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.831166] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.831166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.831166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.831166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.831166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.831166] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.905118] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.333240] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.406475] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.836096] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.912022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.912022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.912022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.912022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.912022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.912022] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1143.074824] env[63014]: INFO networking_nsxv3.common.synchronization [None req-3fbc4f1a-3479-4bff-833c-f2d86315ab6c None None] Enqueued Resource ID: aa393217-7f43-4c9c-b910-2c77e813eaab with Priority: HIGHEST for action port [ 1143.076910] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa393217-7f43-4c9c-b910-2c77e813eaab with Priority: HIGHEST for action port [ 1143.076910] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa393217-7f43-4c9c-b910-2c77e813eaab taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.076910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa393217-7f43-4c9c-b910-2c77e813eaab" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.076910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa393217-7f43-4c9c-b910-2c77e813eaab" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.076910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa393217-7f43-4c9c-b910-2c77e813eaab" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.076910] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa393217-7f43-4c9c-b910-2c77e813eaab',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.103367] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.103367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.103367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.103367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.103367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.116719] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1143.288593] env[63014]: INFO networking_nsxv3.common.synchronization [req-bea49703-05ce-4058-81fa-ac73aed7b879 req-69934b7c-c591-44ae-abaa-79c5b47ab13c tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1143.289078] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1143.289459] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.293145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.293145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.293145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.293145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.293145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.293145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.293145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.293145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.293145] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.339046] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.339265] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.339337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.339683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.339767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.339826] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1143.366484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.366684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.366765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.367039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.367225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.374837] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1143.579521] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa393217-7f43-4c9c-b910-2c77e813eaab [ 1143.579521] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.579895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.579895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.579961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.580152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.580304] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa393217-7f43-4c9c-b910-2c77e813eaab already deleted. [ 1143.580368] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa393217-7f43-4c9c-b910-2c77e813eaab" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.793388] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.793732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.793732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.793826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.793933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.796020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.796020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.796020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.796020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.796020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.796020] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f4789b-3196-4067-98ab-735a7770f947 already deleted. [ 1143.796020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.964359] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.964558] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.966204] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.970017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.970017] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.970017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.970017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.970017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.970017] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.970017] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.970017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.970017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.970017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.970017] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1143.970017] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.970017] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.984823] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.985040] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1143.985201] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.985383] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.985714] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-f90a19e4-dc54-4a3c-947d-250e85242921 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.986289] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-f90a19e4-dc54-4a3c-947d-250e85242921" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.986289] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-f90a19e4-dc54-4a3c-947d-250e85242921" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.986421] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-f90a19e4-dc54-4a3c-947d-250e85242921" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.986473] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f90a19e4-dc54-4a3c-947d-250e85242921',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.018037] env[63014]: INFO networking_nsxv3.common.synchronization [None req-50558ab9-288d-432e-a9c9-1ef23675ee0f tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_rules [ 1144.018738] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_rules [ 1144.019899] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.019991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.020062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.020316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.020388] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.106611] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d28d7daa-ddaf-4fb4-abb9-847562ace3b3 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_rules [ 1144.107560] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_rules [ 1144.107970] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.108118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.491818] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.492066] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.492272] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.492606] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.492872] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.492994] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port f90a19e4-dc54-4a3c-947d-250e85242921 not found, creating... [ 1144.493299] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.493491] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.493622] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.493852] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.494013] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.494398] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.495228] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.495228] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.495228] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.495228] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.495431] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: f90a19e4-dc54-4a3c-947d-250e85242921 is going to be created. [ 1144.515877] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.516135] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.516269] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.516563] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.516877] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.517181] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-f90a19e4-dc54-4a3c-947d-250e85242921" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.540236] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.540318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.540421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.540721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.540759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.540888] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 already deleted. [ 1144.541010] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.541203] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.541391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.541532] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.864544] env[63014]: INFO networking_nsxv3.common.synchronization [req-be962cd0-5133-498e-bef7-c6f519bca739 req-cfecf02b-097d-4a0a-aa5b-dfcb712778e1 tempest-ServerDiskConfigTestJSON-1098154491 tempest-ServerDiskConfigTestJSON-1098154491-project-member] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1144.864544] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGHEST for action security_group_members [ 1144.864544] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.864839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.864873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.866021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.866021] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.866021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.866021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.866021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.866021] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.867973] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.062692] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.062934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.063023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.063406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.063406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.063406] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 already deleted. [ 1145.063568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.125829] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1145.126086] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.264406] env[63014]: INFO networking_nsxv3.common.synchronization [None req-7e81e8ca-5608-4aba-b9d8-a9fea78f91d0 None None] Enqueued Resource ID: 65a318f1-694f-41f4-8b5e-fdd15d83044c with Priority: HIGHEST for action port [ 1145.264676] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65a318f1-694f-41f4-8b5e-fdd15d83044c with Priority: HIGHEST for action port [ 1145.265260] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-65a318f1-694f-41f4-8b5e-fdd15d83044c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.265778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65a318f1-694f-41f4-8b5e-fdd15d83044c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.265854] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65a318f1-694f-41f4-8b5e-fdd15d83044c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.268211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65a318f1-694f-41f4-8b5e-fdd15d83044c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.268296] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65a318f1-694f-41f4-8b5e-fdd15d83044c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.329546] env[63014]: INFO networking_nsxv3.common.synchronization [req-bea49703-05ce-4058-81fa-ac73aed7b879 req-1a82ff5d-e744-4273-902f-b2bc2c232cb1 service nova] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_rules [ 1145.329546] env[63014]: INFO networking_nsxv3.common.synchronization [req-bea49703-05ce-4058-81fa-ac73aed7b879 req-1a82ff5d-e744-4273-902f-b2bc2c232cb1 service nova] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1145.329546] env[63014]: INFO networking_nsxv3.common.synchronization [req-bea49703-05ce-4058-81fa-ac73aed7b879 req-1a82ff5d-e744-4273-902f-b2bc2c232cb1 service nova] Enqueued Resource ID: f90a19e4-dc54-4a3c-947d-250e85242921 with Priority: HIGHEST for action port [ 1145.331104] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_rules [ 1145.331585] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1145.335091] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f90a19e4-dc54-4a3c-947d-250e85242921 with Priority: HIGHEST for action port [ 1145.335091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.335091] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.335091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.335091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.335091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.335942] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.336975] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f90a19e4-dc54-4a3c-947d-250e85242921 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.337316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f90a19e4-dc54-4a3c-947d-250e85242921" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.337543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f90a19e4-dc54-4a3c-947d-250e85242921" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.338240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f90a19e4-dc54-4a3c-947d-250e85242921" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.338475] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f90a19e4-dc54-4a3c-947d-250e85242921',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.369079] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.369293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.369360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.369624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.369757] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.370091] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.370251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.370337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.370513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.370594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.370686] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be updated. [ 1145.385498] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1145.385908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.385908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.386107] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.386378] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.386470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.386530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.386718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.386794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.386897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.387020] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.400655] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.400655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.401099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.401099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.401188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.415430] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: IN_PROGRESS for 2s [ 1145.770358] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65a318f1-694f-41f4-8b5e-fdd15d83044c [ 1145.770719] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.770719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.770872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.771092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.771166] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.771204] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65a318f1-694f-41f4-8b5e-fdd15d83044c already deleted. [ 1145.771288] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65a318f1-694f-41f4-8b5e-fdd15d83044c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.840813] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.841887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.842007] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.844515] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f90a19e4-dc54-4a3c-947d-250e85242921 with status ACTIVE [ 1145.844705] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.844836] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.844899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.845125] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.845218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.845405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.845496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.845557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.845720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.845857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.846064] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.846160] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.846220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.846417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.846417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.846506] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f90a19e4-dc54-4a3c-947d-250e85242921 is going to be updated. [ 1145.866576] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.866903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.866903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.866998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.867187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.867339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f90a19e4-dc54-4a3c-947d-250e85242921" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.889390] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.889567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.889989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.889989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.890127] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.890284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.890338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.890481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.890608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.890701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.890926] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.890993] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.891077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.891319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.891405] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.891499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.891560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.891702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.891778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.891857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.891947] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.343607] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.394063] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b49a7f5-6ed4-481f-81ba-d9ed36714c01: rpc.has_security_group_logging(os_id): False [ 1146.411986] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.412170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.412218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.412626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.412723] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.412955] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.413080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.413142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.413726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.413726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.413726] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.413726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.413726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.413982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.413982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.414264] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.414411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.414509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.414747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.414844] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.414946] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1146.474768] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.475083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.475083] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.475294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.475666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.489396] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1146.845140] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.845326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.845390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.845593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.845695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.845793] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f4789b-3196-4067-98ab-735a7770f947 is going to be created. [ 1146.866981] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.867336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.867336] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.867616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.867728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.877955] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: UNINITIALIZED for 2s [ 1147.068761] env[63014]: INFO networking_nsxv3.common.synchronization [req-d8980028-a944-4af5-9c39-0ef48b4b231e req-131f57f2-5f12-4a5f-b898-bb32075db781 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 1147.069419] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 1147.069735] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.069878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.069944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.070221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.070395] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.070515] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.070586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.070759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.070848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.070942] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.424992] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 in Status: SUCCESS [ 1147.425341] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 deletion is rescheduled due to dependency. [ 1147.425549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.573591] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.787458] env[63014]: INFO networking_nsxv3.common.synchronization [req-fd96f846-ed23-418b-a926-eb272c757f5f req-326c4885-110f-4ce9-943b-330dbd3bcb8f tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1147.789128] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1147.789128] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.789128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.789128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.789128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.789128] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.789128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.790659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.790932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.791869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.791869] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.040415] env[63014]: INFO networking_nsxv3.common.synchronization [req-f6eb45aa-e18b-4fd9-ad8f-deb5ac079acb req-6cd65c6f-c68f-461c-a63e-87509fcaacbf tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1148.041047] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1148.041359] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.041473] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.041536] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.041742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.041890] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.041988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.042075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.042282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.042371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.042462] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.075935] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.283161] env[63014]: INFO networking_nsxv3.common.synchronization [req-2cd854b9-18a6-49a4-9c6c-c74e83236c35 req-3c5c7aa5-9a6c-46f9-8baf-da85e9429064 tempest-ImagesOneServerTestJSON-1912202909 tempest-ImagesOneServerTestJSON-1912202909-project-member] Enqueued Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGHEST for action security_group_members [ 1148.283161] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGHEST for action security_group_members [ 1148.283161] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-f994c7a5-b3ac-4a57-b55b-a769c6119282 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.283161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.283161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.283161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.283161] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.283161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.283161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.283161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.283161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.283161] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.296649] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.363768] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-812 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.363969] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.364117] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.364383] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.364638] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.364797] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.364916] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.365147] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.365300] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.365513] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.365814] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.366059] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.366193] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.366340] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1148.366464] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.366605] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.384347] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.384553] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1148.384732] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.384949] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.385276] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-32e95401-c05d-4892-98c0-89668d28caa6 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.385456] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-32e95401-c05d-4892-98c0-89668d28caa6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.385645] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-32e95401-c05d-4892-98c0-89668d28caa6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.386100] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-32e95401-c05d-4892-98c0-89668d28caa6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.386260] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e95401-c05d-4892-98c0-89668d28caa6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.505168] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1148.505615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.545099] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.545337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.545439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.545765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.545765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.546487] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.546487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.546487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.546487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.546487] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.546736] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1148.569354] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.569509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.569574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.569775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.569937] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.578480] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1148.578480] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.578480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.578480] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.578752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.578848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.580023] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be updated. [ 1148.602538] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.602538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.602538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.602765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.602871] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.610640] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 2s [ 1148.783393] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.783614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.783697] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.783921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.784084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.784301] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.784407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.784469] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.784618] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.784713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.785047] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 is going to be updated. [ 1148.797373] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.813849] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.814778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.814778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.814778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.814778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.825590] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 in Status: IN_PROGRESS for 2s [ 1148.887521] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: SUCCESS [ 1148.887719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.888282] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.888471] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.888597] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.888873] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.889035] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.889187] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 32e95401-c05d-4892-98c0-89668d28caa6 not found, creating... [ 1148.889444] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.889602] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.889720] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.889941] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.890136] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.890437] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.890595] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.890715] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.890924] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.891071] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.891255] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 32e95401-c05d-4892-98c0-89668d28caa6 is going to be created. [ 1148.892059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.892279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.892447] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.892543] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.892605] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.892749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.892824] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.892905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.892989] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.913280] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.913580] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.913746] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.914057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.914319] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.914578] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-32e95401-c05d-4892-98c0-89668d28caa6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.299422] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.299790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.299790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.299926] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.300035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.300140] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1149.325356] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.325542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.325601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.325819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.325961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.334183] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1149.395429] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.764944] env[63014]: INFO networking_nsxv3.common.synchronization [req-f6eb45aa-e18b-4fd9-ad8f-deb5ac079acb req-2ee03bba-12e9-451a-a004-99e52f22944f service nova] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 1149.765207] env[63014]: INFO networking_nsxv3.common.synchronization [req-f6eb45aa-e18b-4fd9-ad8f-deb5ac079acb req-2ee03bba-12e9-451a-a004-99e52f22944f service nova] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1149.765356] env[63014]: INFO networking_nsxv3.common.synchronization [req-f6eb45aa-e18b-4fd9-ad8f-deb5ac079acb req-2ee03bba-12e9-451a-a004-99e52f22944f service nova] Enqueued Resource ID: 32e95401-c05d-4892-98c0-89668d28caa6 with Priority: HIGHEST for action port [ 1149.765891] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 1149.766027] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1149.766172] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32e95401-c05d-4892-98c0-89668d28caa6 with Priority: HIGHEST for action port [ 1149.766400] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.766516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.768517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.768517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.768517] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.768517] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.768517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.768517] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-32e95401-c05d-4892-98c0-89668d28caa6 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.768517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32e95401-c05d-4892-98c0-89668d28caa6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.768517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32e95401-c05d-4892-98c0-89668d28caa6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.768517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32e95401-c05d-4892-98c0-89668d28caa6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.768517] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32e95401-c05d-4892-98c0-89668d28caa6',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.897199] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f4789b-3196-4067-98ab-735a7770f947: rpc.has_security_group_logging(os_id): False [ 1149.914696] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.914908] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.914984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.915214] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.915307] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.915556] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.915652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.915991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.915991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.915991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.916095] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f4789b-3196-4067-98ab-735a7770f947 is going to be created. [ 1149.965295] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.965965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.966093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.966316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.966501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.977778] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: IN_PROGRESS for 2s [ 1150.274020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.274020] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32e95401-c05d-4892-98c0-89668d28caa6 with status ACTIVE [ 1150.274020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.274020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.274020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.274020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.274667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.274667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.274667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.274667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.274667] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32e95401-c05d-4892-98c0-89668d28caa6 is going to be updated. [ 1150.295138] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.296463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.296463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.296463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.296463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.296639] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32e95401-c05d-4892-98c0-89668d28caa6" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.587154] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1150.587520] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c deletion is rescheduled due to dependency. [ 1150.587520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.587718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.588012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.588229] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.588352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.588419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.588582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.588664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.588758] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.619529] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 4s [ 1150.834811] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 in Status: SUCCESS [ 1150.835080] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 deletion is rescheduled due to dependency. [ 1150.835157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.091257] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.343136] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1151.343547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.593189] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.989319] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: SUCCESS [ 1151.989538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.070539] env[63014]: INFO networking_nsxv3.common.synchronization [req-f4dfe33b-f469-4a54-9135-790405befd1f req-cf239e32-2a38-4403-83eb-17c1b48490a9 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_members [ 1152.071332] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_members [ 1152.071443] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c37e051e-8989-4b52-b4f6-04f6b7301ee0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.071566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.071661] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.071899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.072070] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.072396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.072396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.072396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.072636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.072636] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.095644] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.095916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.095916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.096118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.096210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.096491] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1152.138864] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.139047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.139134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.139352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.139478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.155808] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1152.575104] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.575230] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.575305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.575547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.575659] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.575940] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.576056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.576590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.576590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.576590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.576590] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 already deleted. [ 1152.576590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.578329] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.578539] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.578682] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.578964] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.579239] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.579400] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.579523] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.579737] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.579881] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.580117] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.580288] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.580420] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.580534] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.580648] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1152.580755] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.580887] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.599294] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.599554] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1152.599601] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.599730] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.599992] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.600170] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.600292] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.600596] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.600788] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d8e889b-dad2-465e-8d1e-f18a01c4c2fd',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.628852] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 1152.629076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.102904] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.103186] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.103325] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.103618] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.103774] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.103933] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 0d8e889b-dad2-465e-8d1e-f18a01c4c2fd not found, creating... [ 1153.104215] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.104375] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.104496] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.104714] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.104857] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.105181] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.105345] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.105466] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.105679] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.105824] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.106114] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 0d8e889b-dad2-465e-8d1e-f18a01c4c2fd is going to be created. [ 1153.126422] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.126609] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.126738] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.126973] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.127219] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.127434] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.129481] env[63014]: INFO networking_nsxv3.common.synchronization [req-f4dfe33b-f469-4a54-9135-790405befd1f req-82d9e79d-e9ae-4474-b2c0-2a9aaf97ee75 service nova] Enqueued Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_rules [ 1154.129779] env[63014]: INFO networking_nsxv3.common.synchronization [req-f4dfe33b-f469-4a54-9135-790405befd1f req-82d9e79d-e9ae-4474-b2c0-2a9aaf97ee75 service nova] Enqueued Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_members [ 1154.130334] env[63014]: INFO networking_nsxv3.common.synchronization [req-f4dfe33b-f469-4a54-9135-790405befd1f req-82d9e79d-e9ae-4474-b2c0-2a9aaf97ee75 service nova] Enqueued Resource ID: 0d8e889b-dad2-465e-8d1e-f18a01c4c2fd with Priority: HIGHEST for action port [ 1154.130579] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_rules [ 1154.130727] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_members [ 1154.130828] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8e889b-dad2-465e-8d1e-f18a01c4c2fd with Priority: HIGHEST for action port [ 1154.131252] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.131462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.131563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.131817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.131933] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.132915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c37e051e-8989-4b52-b4f6-04f6b7301ee0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.136765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.136765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.136765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.136765] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.136765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.136765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.136765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.136765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.136765] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.136765] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.137381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.137381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.137381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.137711] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d8e889b-dad2-465e-8d1e-f18a01c4c2fd',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.164702] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1154.164985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.165485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.165777] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.166029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.166190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.166279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.166462] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.166552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.166746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.166785] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.347929] env[63014]: INFO networking_nsxv3.common.synchronization [req-531248fb-ff80-4883-ae4c-d98f72340dbd req-013b1a0f-5885-4135-bb49-2f306b44f293 tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1154.348508] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1154.348814] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.348938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.349013] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.350846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.351090] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.351242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.352070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.352070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.352070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.352070] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.637938] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.638948] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d8e889b-dad2-465e-8d1e-f18a01c4c2fd with status ACTIVE [ 1154.639184] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.639342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.639413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.639643] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.639734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.639923] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.640035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.640102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.640400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.640400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.640531] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.640625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.640685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.640828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.640902] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.640992] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d8e889b-dad2-465e-8d1e-f18a01c4c2fd is going to be updated. [ 1154.642962] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c37e051e-8989-4b52-b4f6-04f6b7301ee0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.643064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.661818] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.661955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.662037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.662248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.662385] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.662546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d8e889b-dad2-465e-8d1e-f18a01c4c2fd" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.669296] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.854023] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.854023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.854023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.854250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.854250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.854429] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.854530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.854588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.854759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.854837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.854927] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1154.882337] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.882484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.882566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.882774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.882945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.892115] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1155.143576] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.171607] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9141a736-220e-4a6b-b407-916c87c8099c: rpc.has_security_group_logging(os_id): False [ 1155.188152] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.188318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.188386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.188595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.188686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.189013] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.189180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.189281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.189468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.189550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.189639] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1155.241751] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.241911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.241969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.242187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.242333] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.253430] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1155.650679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.650679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.650679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.650679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.650679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.650679] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 is going to be created. [ 1155.686240] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.686391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.686450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.686663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.686833] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.699851] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 in Status: UNINITIALIZED for 2s [ 1156.901907] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1156.902263] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1156.902263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.265843] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1157.265843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.710859] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 in Status: SUCCESS [ 1157.710859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.710859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.710859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.711059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.711178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.711241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.711405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.711499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.711587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.711680] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.214310] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.719026] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c37e051e-8989-4b52-b4f6-04f6b7301ee0: rpc.has_security_group_logging(os_id): False [ 1158.737429] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.737564] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.737652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.737888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.737987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.738292] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.738400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.738485] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.738622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.738701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.738795] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 is going to be created. [ 1158.806737] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.806737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.806896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.807023] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.808098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.820865] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 in Status: IN_PROGRESS for 2s [ 1159.349741] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1159.350067] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1160.549095] env[63014]: INFO networking_nsxv3.common.synchronization [None req-eecc89d4-30ec-4a9c-bc0d-356a3b8081c6 None None] Enqueued Resource ID: aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa with Priority: HIGHEST for action port [ 1160.549679] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa with Priority: HIGHEST for action port [ 1160.550020] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.550154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.550223] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.550502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.550572] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.833331] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 in Status: SUCCESS [ 1160.833572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.049904] env[63014]: INFO networking_nsxv3.common.synchronization [None req-68d0cfcc-126d-41fc-b5e6-0f626b917850 tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1161.050527] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1161.050862] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.051616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.051616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.051616] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.051616] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.052378] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa [ 1161.052480] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.052587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.052654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.052820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.053010] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.053010] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa already deleted. [ 1161.053088] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa6fa817-cb3d-4cee-bef4-7a489a2bb1aa" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.188177] env[63014]: INFO networking_nsxv3.common.synchronization [None req-9d97e72e-feff-4c0b-a9ea-a0a200aa8cb2 tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1161.189207] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1161.189607] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.189751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.574446] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.574446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.574446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.574832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.574832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.574920] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd050717-3504-424f-943d-0714073722e0 already deleted. [ 1161.574983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.575372] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.575466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.575578] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.098743] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.098743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.098743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.098743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.098977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.098977] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd050717-3504-424f-943d-0714073722e0 already deleted. [ 1162.099118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.706779] env[63014]: INFO networking_nsxv3.common.synchronization [req-1810da05-beae-456b-932b-d475a3907769 req-98ea3e82-d69a-4fe2-87cc-5330d020f0bc tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1162.707078] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1162.707413] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.707524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.707524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.707708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.708035] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.708035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.710319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.710500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.710553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.710689] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.739733] env[63014]: INFO networking_nsxv3.common.synchronization [None req-658957d5-2ae2-4dbd-8999-d12ae8d8b104 None None] Enqueued Resource ID: 6438fa3b-3b6c-4951-8a42-ca4587fa66a5 with Priority: HIGHEST for action port [ 1162.740624] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6438fa3b-3b6c-4951-8a42-ca4587fa66a5 with Priority: HIGHEST for action port [ 1162.740700] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-6438fa3b-3b6c-4951-8a42-ca4587fa66a5 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.740830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6438fa3b-3b6c-4951-8a42-ca4587fa66a5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.740897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6438fa3b-3b6c-4951-8a42-ca4587fa66a5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.742109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6438fa3b-3b6c-4951-8a42-ca4587fa66a5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.742215] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6438fa3b-3b6c-4951-8a42-ca4587fa66a5',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.215913] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.245162] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6438fa3b-3b6c-4951-8a42-ca4587fa66a5 [ 1163.245862] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.245862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.245862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.245862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.245862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.246412] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6438fa3b-3b6c-4951-8a42-ca4587fa66a5 already deleted. [ 1163.246412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6438fa3b-3b6c-4951-8a42-ca4587fa66a5" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.718628] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.764485] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.764762] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.764963] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.765280] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.765559] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.765722] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.765864] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.766128] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.766297] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.766543] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.766662] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.766788] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.766902] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.767031] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1163.767155] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.767295] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.785881] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.786074] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1163.786266] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.786462] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.786783] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.786968] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.787125] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.787451] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.787598] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.221534] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.221787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.221787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.221978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.222085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.222188] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f4789b-3196-4067-98ab-735a7770f947 is going to be updated. [ 1164.252575] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.252794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.252794] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.252977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.253134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.261311] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: IN_PROGRESS for 2s [ 1164.290432] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.290658] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.290789] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.291105] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.291274] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.291435] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0 not found, creating... [ 1164.291699] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.291861] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.291982] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.292218] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.292365] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.292648] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.292808] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.292928] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.293166] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.293305] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.293457] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0 is going to be created. [ 1164.310864] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.311054] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.311183] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.311402] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.311645] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.311860] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.026058] env[63014]: INFO networking_nsxv3.common.synchronization [req-1810da05-beae-456b-932b-d475a3907769 req-dc892ccb-901a-4c61-8fe9-57e4509e41e7 service nova] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_rules [ 1165.026331] env[63014]: INFO networking_nsxv3.common.synchronization [req-1810da05-beae-456b-932b-d475a3907769 req-dc892ccb-901a-4c61-8fe9-57e4509e41e7 service nova] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1165.026521] env[63014]: INFO networking_nsxv3.common.synchronization [req-1810da05-beae-456b-932b-d475a3907769 req-dc892ccb-901a-4c61-8fe9-57e4509e41e7 service nova] Enqueued Resource ID: 659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0 with Priority: HIGHEST for action port [ 1165.026729] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_rules [ 1165.027377] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1165.027377] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0 with Priority: HIGHEST for action port [ 1165.027852] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.027976] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.028060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.028337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.028484] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.030969] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.030969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.030969] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.030969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.030969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.030969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.030969] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.279721] env[63014]: INFO networking_nsxv3.common.synchronization [req-a6dfe4c5-b727-4d04-aa01-19fc1a00538a req-e0323795-7034-40b7-9ba9-884dba8113fa tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1165.280139] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1165.280438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.280832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.280832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.280832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.280996] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.281060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.281095] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.281232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.281310] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.281397] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.533751] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.533919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.534212] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0 with status ACTIVE [ 1165.534281] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.534381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.534444] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.534678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.534812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.534941] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.535043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.535098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.535258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.535337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.535513] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.535646] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.535646] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.535788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.535888] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.535948] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0 is going to be updated. [ 1165.561552] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.561771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.561827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.562082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.562279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.562624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-659c40e8-7fc7-43c2-a7cd-8e2fd8995ad0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.636140] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.636438] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.636533] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.636777] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.637074] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.637259] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.637446] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.637645] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.637815] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.638069] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.638235] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.638354] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.638443] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.638563] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1165.638699] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.638869] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.672222] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.672392] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1165.672543] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.672671] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.672992] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.673189] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.673381] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.673725] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.673868] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6907deb-0a1b-4f0d-b064-ee6c9fff032f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.783030] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.176428] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.176816] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.176816] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.177102] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.177256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.177419] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port c6907deb-0a1b-4f0d-b064-ee6c9fff032f not found, creating... [ 1166.177687] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.177854] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.177972] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.178264] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.178437] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.178725] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.178884] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.179015] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.179256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.179426] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.179578] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: c6907deb-0a1b-4f0d-b064-ee6c9fff032f is going to be created. [ 1166.199373] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.199547] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.199661] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.199912] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.200161] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.200387] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.271524] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: SUCCESS [ 1166.271741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.271907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.272147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.272336] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.272453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.272610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.272786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.272867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.272965] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.284635] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.776026] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.786644] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.786819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.786914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.787198] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.787298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.787402] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1166.815360] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.815517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.815563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.815769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.815912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.824878] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1166.881922] env[63014]: INFO networking_nsxv3.common.synchronization [req-a6dfe4c5-b727-4d04-aa01-19fc1a00538a req-549942dc-eed5-4cf0-bcc3-91e65bda6020 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1166.882146] env[63014]: INFO networking_nsxv3.common.synchronization [req-a6dfe4c5-b727-4d04-aa01-19fc1a00538a req-549942dc-eed5-4cf0-bcc3-91e65bda6020 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1166.882302] env[63014]: INFO networking_nsxv3.common.synchronization [req-a6dfe4c5-b727-4d04-aa01-19fc1a00538a req-549942dc-eed5-4cf0-bcc3-91e65bda6020 service nova] Enqueued Resource ID: c6907deb-0a1b-4f0d-b064-ee6c9fff032f with Priority: HIGHEST for action port [ 1166.882537] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1166.882671] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1166.882767] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6907deb-0a1b-4f0d-b064-ee6c9fff032f with Priority: HIGHEST for action port [ 1166.883321] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.883449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.883508] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.883711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.883789] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.888099] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.888099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.888099] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.888099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.888099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.888099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.888099] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6907deb-0a1b-4f0d-b064-ee6c9fff032f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.279314] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.390157] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.390290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.390534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6907deb-0a1b-4f0d-b064-ee6c9fff032f with status ACTIVE [ 1167.390686] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.390803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.390881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.391195] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.391293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.391471] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.391569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.391630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.391776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.391850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.392037] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.392139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.392218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.392393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.392476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.392561] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6907deb-0a1b-4f0d-b064-ee6c9fff032f is going to be updated. [ 1167.412808] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.412947] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.413071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.413394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.413598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.413835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6907deb-0a1b-4f0d-b064-ee6c9fff032f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.780832] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.780912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.781009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.781218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.781304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.781405] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f4789b-3196-4067-98ab-735a7770f947 is going to be updated. [ 1167.813427] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.813570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.813628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.813840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.813984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.824831] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: IN_PROGRESS for 2s [ 1168.835030] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1168.835030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.835497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.835497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.835700] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.835819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.835890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.836041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.836149] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.836271] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.276959] env[63014]: INFO networking_nsxv3.common.synchronization [req-570dd29d-fe1f-4f48-8de7-6b3bead4e0b4 req-96b27756-11ce-4071-b156-c1a7fcb19fe7 tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1169.277633] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1169.278812] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.279032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.279145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.279414] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.279648] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.280038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.280038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.280038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.280245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.280282] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.338313] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.783504] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.783671] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.783736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.783964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.784070] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.784302] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.784381] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.784438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.784590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.784665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.784753] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1169.820079] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.820159] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.820228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.820419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.820609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.832084] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: SUCCESS [ 1169.832271] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.832421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.832601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.832768] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.832872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.832952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.833152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.833254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.833355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.833459] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.834772] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1169.840222] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.844466] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.844734] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.844870] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.845130] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.845842] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.846065] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.846198] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.846600] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.846796] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.847136] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.847270] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.847391] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.847506] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.847622] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1169.847859] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.847859] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.865793] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.865953] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1169.866107] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.866270] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.866545] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.866710] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.866832] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.867131] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.867273] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.335902] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.342176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.342355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.342422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.342607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.342694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.343137] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1170.369174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.369339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.369410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.369614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.369761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.371121] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.371373] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.371546] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.371838] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.372054] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.372246] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330 not found, creating... [ 1170.372544] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.372744] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.372911] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.373191] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.373379] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.373675] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.373908] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.374054] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.374305] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.374457] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.374629] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330 is going to be created. [ 1170.382584] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1170.392643] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.392869] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.392996] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.393284] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.393517] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.393743] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.838746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64f4789b-3196-4067-98ab-735a7770f947: rpc.has_security_group_logging(os_id): False [ 1170.855880] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.856360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.856360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.856360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.856488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.856684] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.856852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.856852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.857019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.857098] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.857204] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64f4789b-3196-4067-98ab-735a7770f947 is going to be updated. [ 1170.916543] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.916714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.916764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.916960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.917420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.932223] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: IN_PROGRESS for 2s [ 1171.099153] env[63014]: INFO networking_nsxv3.common.synchronization [req-570dd29d-fe1f-4f48-8de7-6b3bead4e0b4 req-c4a0a8c3-d271-4271-a016-4f621f409cd6 service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1171.099153] env[63014]: INFO networking_nsxv3.common.synchronization [req-570dd29d-fe1f-4f48-8de7-6b3bead4e0b4 req-c4a0a8c3-d271-4271-a016-4f621f409cd6 service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1171.099153] env[63014]: INFO networking_nsxv3.common.synchronization [req-570dd29d-fe1f-4f48-8de7-6b3bead4e0b4 req-c4a0a8c3-d271-4271-a016-4f621f409cd6 service nova] Enqueued Resource ID: e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330 with Priority: HIGHEST for action port [ 1171.099153] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1171.099153] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1171.099153] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330 with Priority: HIGHEST for action port [ 1171.099153] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.099153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.099153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.099153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.099153] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.099733] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.099733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.099915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.100019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.100081] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.100319] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.100455] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.600884] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.601041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.602378] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330 with status ACTIVE [ 1171.602560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.602669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.602737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.602941] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.603045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.603220] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.603359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.603395] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.603517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.603598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.603776] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.603869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.603930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.604087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.604164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.604249] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330 is going to be updated. [ 1171.605911] env[63014]: INFO networking_nsxv3.common.synchronization [req-8fe81cd6-53c6-49c9-a855-9b5280624d75 req-49de9dad-2190-4b2e-86d1-293da1d87dc9 tempest-ServerActionsTestOtherA-1561727594 tempest-ServerActionsTestOtherA-1561727594-project-member] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 1171.606469] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGHEST for action security_group_members [ 1171.607185] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.607298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.607360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.607514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.607655] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.607749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.607812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.607956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.608045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.608148] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.627345] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.627477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.627546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.627740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.627872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.628042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1764e5d-bf4d-4d5f-9863-fc5ec3fa3330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.843298] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1171.843447] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1171.843562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.843715] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.843939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.844146] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.844264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.844329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.844558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.844648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.844743] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.111557] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.111557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.111557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.111557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.111557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.112028] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.112028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.112028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.112138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.112138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.112228] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be updated. [ 1172.152135] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.152274] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.152348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.152545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.152686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.161052] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: IN_PROGRESS for 2s [ 1172.346529] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.393315] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1172.393539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.393700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.393921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.394215] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.394345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.394412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.394580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.394663] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.394755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.394847] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.479348] env[63014]: INFO networking_nsxv3.common.synchronization [req-6129293e-7875-48fb-8c17-96c351f0dc96 req-d3cbef3b-c801-4f83-a2d0-7dbb708b8ab5 tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1172.479866] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1172.480192] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.480309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.480377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.480641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.480820] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.480924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.480996] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.481688] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.481832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.481962] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.784605] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-246 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.784907] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-246" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.785129] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-246" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.785474] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-246" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.786395] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.786395] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.786395] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.786395] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.786602] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.786819] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.786981] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.787170] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.787339] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.787515] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1172.787672] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.787871] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.804757] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.804960] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1172.805164] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.805378] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-246" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.805723] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-f2f27209-06cc-4e48-a2dc-106b07680907 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.805918] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.806064] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.806385] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.806564] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f27209-06cc-4e48-a2dc-106b07680907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.848932] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.897762] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.898039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.898039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.898251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.898523] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.898620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.898620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.898787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.898919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.898984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.899099] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.899347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.899347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.899434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.899644] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.899736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.899790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.899929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.900014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.900126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.900237] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.944972] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: SUCCESS [ 1172.945248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.984401] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.984574] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.985152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.985152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.985152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.985504] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.985504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.985504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.985632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.985632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.985707] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 already deleted. [ 1172.985817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.309707] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.310170] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.310170] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.310411] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.310530] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.310692] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port f2f27209-06cc-4e48-a2dc-106b07680907 not found, creating... [ 1173.310959] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.311154] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.311277] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.311535] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.311687] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.311972] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.312994] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.313157] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.313404] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.313527] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.313678] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: f2f27209-06cc-4e48-a2dc-106b07680907 is going to be created. [ 1173.332525] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.332809] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.333214] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.333289] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.333545] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.333803] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.351484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.351628] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.351718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.351973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.352082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.352184] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1173.380890] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.381077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.381157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.381380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.381547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.389727] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1173.401843] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c29d6f-7489-45e1-8183-08f2d7095d33: rpc.has_security_group_logging(os_id): False [ 1173.423532] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.423700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.423784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.423991] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.424099] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.424295] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.424394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.424457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.424614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.424695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.424880] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.424974] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.425047] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.425192] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.425267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.425457] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.425553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.425613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.425817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.425932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.426408] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1173.509341] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.509544] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.509598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.509798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.509945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.529985] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1174.119948] env[63014]: INFO networking_nsxv3.common.synchronization [req-6129293e-7875-48fb-8c17-96c351f0dc96 req-f84bf27f-d5ad-4ea0-9d8b-f95ba7efe0b9 service nova] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1174.120088] env[63014]: INFO networking_nsxv3.common.synchronization [req-6129293e-7875-48fb-8c17-96c351f0dc96 req-f84bf27f-d5ad-4ea0-9d8b-f95ba7efe0b9 service nova] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1174.120241] env[63014]: INFO networking_nsxv3.common.synchronization [req-6129293e-7875-48fb-8c17-96c351f0dc96 req-f84bf27f-d5ad-4ea0-9d8b-f95ba7efe0b9 service nova] Enqueued Resource ID: f2f27209-06cc-4e48-a2dc-106b07680907 with Priority: HIGHEST for action port [ 1174.120747] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1174.120887] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1174.121063] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f27209-06cc-4e48-a2dc-106b07680907 with Priority: HIGHEST for action port [ 1174.121253] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.121436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.121436] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.121626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.121696] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.122502] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.122653] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.122702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.122850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.122974] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.123110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.123242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.123326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.123459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.123459] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.124124] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f27209-06cc-4e48-a2dc-106b07680907 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.124231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.124346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.124438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.124502] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f27209-06cc-4e48-a2dc-106b07680907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.170352] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b44cf44-3516-4644-9659-498297843d9a in Status: SUCCESS [ 1174.170473] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b44cf44-3516-4644-9659-498297843d9a deletion is rescheduled due to dependency. [ 1174.170691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.626534] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.626534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.626902] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.631122] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2f27209-06cc-4e48-a2dc-106b07680907 with status ACTIVE [ 1174.631122] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.631122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.631122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.631122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.631122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.631122] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.631122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.631122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.631568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.631568] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.631568] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.631681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.631681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.632238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.632238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.632238] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2f27209-06cc-4e48-a2dc-106b07680907 is going to be updated. [ 1174.653177] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.653370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.653370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.653549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.653685] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.653839] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.130019] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.398454] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1175.398680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.398861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.399108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.399300] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.399415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.399499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.399667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.399838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.400145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.400246] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.547789] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1175.548039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.633507] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.633966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.633966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.633966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.633966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.634295] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be created. [ 1175.658219] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.658438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.658554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.658923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.659057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.668764] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: UNINITIALIZED for 2s [ 1175.893130] env[63014]: INFO networking_nsxv3.common.synchronization [None req-654dae7c-8b80-4b30-b933-3aa6b48583a1 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1175.893130] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1175.893130] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.893130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.893130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.893130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.893130] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.893130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.893130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.893130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.893130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.893130] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.906679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.906679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.906679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.906679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.906679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.907251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.907251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.907251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.907251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.908534] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.396493] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.396741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.396741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.396938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.397043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.397250] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.397348] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.397406] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.397563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.397641] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.397728] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1176.411028] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b49a7f5-6ed4-481f-81ba-d9ed36714c01: rpc.has_security_group_logging(os_id): False [ 1176.422230] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.422376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.422501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.422631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.422774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.430211] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.430211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.430211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.430211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.430211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.430656] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.430656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.430656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.430831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.430883] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.431071] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.431178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.431233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.431402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.431491] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.431685] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.432796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.432796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.432796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.432796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.432796] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1176.435303] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1176.495895] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.496201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.496300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.496612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.497043] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.515902] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1177.665088] env[63014]: INFO networking_nsxv3.common.synchronization [req-e44cef10-6d2d-4cfa-9b8b-cc5afd8c927d req-cccb5b04-cc45-421d-bf19-4c451c4bb781 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1177.665615] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1177.666545] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.666545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.666683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.666816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.666989] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.667110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.667172] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.668705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.668812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.668906] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.681662] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: SUCCESS [ 1177.681887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.682354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.682583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.683120] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.683120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.683120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.683120] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.683427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.683427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.683427] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.172421] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.187904] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.446036] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1178.446896] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 deletion is rescheduled due to dependency. [ 1178.446896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.528349] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1178.528514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.678476] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.689464] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd050717-3504-424f-943d-0714073722e0: rpc.has_security_group_logging(os_id): False [ 1178.707800] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.707977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.708102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.708826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.708826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.708826] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.708977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.708977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.709161] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.709280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.709422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be created. [ 1178.767560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.767776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.767848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.768022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.768245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.778535] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd050717-3504-424f-943d-0714073722e0 in Status: IN_PROGRESS for 2s [ 1179.181032] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.181032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.181032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.181282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.181282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.181354] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1179.209027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.209165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.209221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.209504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.209687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.219340] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1180.791013] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd050717-3504-424f-943d-0714073722e0 in Status: SUCCESS [ 1180.791275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.229037] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1181.229239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.667095] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1182.667440] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1183.265840] env[63014]: INFO networking_nsxv3.common.synchronization [req-88041bd2-2dfd-448e-b688-77d3ad3d06c8 req-767dacc6-80a3-4a38-8091-ccf5ec5da50e tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1183.266444] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1183.266778] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.266959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.267217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.267468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.267631] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.267765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.267868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.268103] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.268253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.268397] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.770341] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.770791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.770791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.770791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.771130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.771130] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.771321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.771321] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.771442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.771442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.771555] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1183.797055] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.797218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.797287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.797467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.797603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.805159] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1185.815750] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1185.816036] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1185.816084] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.995202] env[63014]: INFO networking_nsxv3.common.synchronization [req-f9f5647d-ea83-476c-9c02-d6e12a769739 req-c8f55ac3-e316-4e8b-801f-805d6f96a758 tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1187.995726] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1187.996038] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.996163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.996231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.996431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.996585] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.996700] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.996764] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.996952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.996986] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.997489] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.245716] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-932 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.245935] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.246075] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.246366] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.246967] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.247278] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.247418] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.247642] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.247947] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.248187] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.248308] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.248423] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.248538] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.248711] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1188.248839] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.248980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.266953] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.267134] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1188.267277] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.267442] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-932" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.267720] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-111bd00a-f5cb-4498-b1b7-eaf493212142 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.267885] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-111bd00a-f5cb-4498-b1b7-eaf493212142" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.268015] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-111bd00a-f5cb-4498-b1b7-eaf493212142" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.268305] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-111bd00a-f5cb-4498-b1b7-eaf493212142" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.268447] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('111bd00a-f5cb-4498-b1b7-eaf493212142',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.499783] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.771089] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.771478] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.771668] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.772011] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.772219] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.772422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 111bd00a-f5cb-4498-b1b7-eaf493212142 not found, creating... [ 1188.772737] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.772952] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.773124] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.773388] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.773573] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.773899] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.774119] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.774279] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.774530] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.774710] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.774896] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 111bd00a-f5cb-4498-b1b7-eaf493212142 is going to be created. [ 1188.796252] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.796457] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.796617] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.796895] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.797154] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.797384] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-111bd00a-f5cb-4498-b1b7-eaf493212142" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.003038] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.505530] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.505788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.505955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.506434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.506619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.506695] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1189.516103] env[63014]: INFO networking_nsxv3.common.synchronization [req-f9f5647d-ea83-476c-9c02-d6e12a769739 req-11c1141e-ad4b-4734-bfc2-a4a52426aa30 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1189.516367] env[63014]: INFO networking_nsxv3.common.synchronization [req-f9f5647d-ea83-476c-9c02-d6e12a769739 req-11c1141e-ad4b-4734-bfc2-a4a52426aa30 service nova] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1189.516507] env[63014]: INFO networking_nsxv3.common.synchronization [req-f9f5647d-ea83-476c-9c02-d6e12a769739 req-11c1141e-ad4b-4734-bfc2-a4a52426aa30 service nova] Enqueued Resource ID: 111bd00a-f5cb-4498-b1b7-eaf493212142 with Priority: HIGHEST for action port [ 1189.516772] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_rules [ 1189.516943] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1189.517064] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 111bd00a-f5cb-4498-b1b7-eaf493212142 with Priority: HIGHEST for action port [ 1189.517656] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.517780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.517870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.520718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.520718] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.520718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.520718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.520718] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-111bd00a-f5cb-4498-b1b7-eaf493212142 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.520718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-111bd00a-f5cb-4498-b1b7-eaf493212142" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.520718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-111bd00a-f5cb-4498-b1b7-eaf493212142" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.520718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-111bd00a-f5cb-4498-b1b7-eaf493212142" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.520718] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('111bd00a-f5cb-4498-b1b7-eaf493212142',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.535942] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.536174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.536174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.536458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.536509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.544465] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1190.022107] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.022107] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.023387] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 111bd00a-f5cb-4498-b1b7-eaf493212142 with status ACTIVE [ 1190.023568] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.023683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.023745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.023950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.024052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.024222] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.024324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.024383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.024519] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.024600] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.024773] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.024866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.024923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.025073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.025142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.025223] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 111bd00a-f5cb-4498-b1b7-eaf493212142 is going to be updated. [ 1190.045211] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.045347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.045410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.045598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.045731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.045890] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-111bd00a-f5cb-4498-b1b7-eaf493212142" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.819544] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.819800] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.819996] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.820442] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.820708] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.820868] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.820994] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.821236] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.821389] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.821600] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.821722] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.821846] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.821954] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.822081] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1190.822188] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.822326] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.840992] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.841210] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1190.841316] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.841481] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.841794] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-851e3de9-9bb9-44fe-abee-b7031409f089 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.841966] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.842101] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.842423] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.842567] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('851e3de9-9bb9-44fe-abee-b7031409f089',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.346127] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.346127] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.346127] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.346127] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.346621] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.346621] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 851e3de9-9bb9-44fe-abee-b7031409f089 not found, creating... [ 1191.346764] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.346824] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.346930] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.347174] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.347318] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.347600] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.347763] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.347904] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.348104] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.348245] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.348383] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 851e3de9-9bb9-44fe-abee-b7031409f089 is going to be created. [ 1191.366683] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.366874] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.366980] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.367235] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.367455] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.367674] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.555151] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1191.555520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.555791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.556168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.556459] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.556637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.556771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.557056] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.557210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.557367] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.040962] env[63014]: INFO networking_nsxv3.common.synchronization [req-8a6bcd70-dfe9-4143-a090-efb1ffb9224a req-b3cae08f-1d30-4247-9f5e-54984982d798 service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 1192.041215] env[63014]: INFO networking_nsxv3.common.synchronization [req-8a6bcd70-dfe9-4143-a090-efb1ffb9224a req-b3cae08f-1d30-4247-9f5e-54984982d798 service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1192.041368] env[63014]: INFO networking_nsxv3.common.synchronization [req-8a6bcd70-dfe9-4143-a090-efb1ffb9224a req-b3cae08f-1d30-4247-9f5e-54984982d798 service nova] Enqueued Resource ID: 851e3de9-9bb9-44fe-abee-b7031409f089 with Priority: HIGHEST for action port [ 1192.041887] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 1192.042105] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1192.042238] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851e3de9-9bb9-44fe-abee-b7031409f089 with Priority: HIGHEST for action port [ 1192.042522] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.042644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.042740] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.042913] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.042994] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.047026] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.047026] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.047026] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.047026] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-851e3de9-9bb9-44fe-abee-b7031409f089 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.047026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.047026] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('851e3de9-9bb9-44fe-abee-b7031409f089',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.059450] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.547958] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.548254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.548326] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.549275] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 851e3de9-9bb9-44fe-abee-b7031409f089 with status ACTIVE [ 1192.549478] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.549588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.549655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.549867] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.549954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.550138] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.550238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.550299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.550449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.550527] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.550706] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.550799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.550860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.551025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.551080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.551167] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 851e3de9-9bb9-44fe-abee-b7031409f089 is going to be updated. [ 1192.561439] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.570811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.570980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.571124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.571326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.571460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.571608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.053773] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.062919] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.063065] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.063142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.063344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.063438] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.063539] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1193.110615] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.110771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.110819] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.111036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.111197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.121732] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1193.557145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.557145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.557145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.557145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.557145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.557574] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1193.585437] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.585662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.585728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.586044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.586253] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.594965] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1194.049742] env[63014]: INFO networking_nsxv3.common.synchronization [req-d2b101b3-008f-478f-8bfc-fca5a1f510f0 req-8d01d019-204d-4e65-882a-c6a20d7fb8fc tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1194.050651] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1194.050651] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.050651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.050651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.050879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.051092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.051217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.051217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.051369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.051454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.051548] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.370823] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-923 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.371198] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.371441] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.371893] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.372369] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.372644] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.372871] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.373321] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.373590] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.373962] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.374188] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.374395] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.374608] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.374814] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1194.375028] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.375283] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.393038] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.393356] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1194.393595] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.393910] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-923" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.394448] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.394772] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.394992] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.395514] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.395751] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.553946] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.554126] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.554210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.554424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.554513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.554733] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.554833] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.554884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.555117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.555218] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.555347] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1194.597027] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.597504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.597504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.597504] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.597687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.607609] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1194.899086] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.899414] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.899537] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.899997] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.900243] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.900445] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf not found, creating... [ 1194.900753] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.901085] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.901085] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.901402] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.901581] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.901920] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.902107] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.902236] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.902472] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.902616] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.902763] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf is going to be created. [ 1194.922018] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.922244] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.922373] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.922618] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.922899] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.923143] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.130953] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1195.131199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.131358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.131567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.131808] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.131887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.131924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.132094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.132176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.132261] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.132348] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.603735] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 4s [ 1195.616945] env[63014]: INFO networking_nsxv3.common.synchronization [req-d2b101b3-008f-478f-8bfc-fca5a1f510f0 req-9648142e-aa40-4176-8120-b9796a9cd428 service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1195.617142] env[63014]: INFO networking_nsxv3.common.synchronization [req-d2b101b3-008f-478f-8bfc-fca5a1f510f0 req-9648142e-aa40-4176-8120-b9796a9cd428 service nova] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1195.617286] env[63014]: INFO networking_nsxv3.common.synchronization [req-d2b101b3-008f-478f-8bfc-fca5a1f510f0 req-9648142e-aa40-4176-8120-b9796a9cd428 service nova] Enqueued Resource ID: 8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf with Priority: HIGHEST for action port [ 1195.617563] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_rules [ 1195.617638] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1195.617828] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf with Priority: HIGHEST for action port [ 1195.619989] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.620154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.620245] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.620595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.620595] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.621557] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.621655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.622272] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.623188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.623289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.623477] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.623561] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.633712] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.633837] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.633918] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.634114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.634276] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.634376] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.634450] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.634585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.634675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.634765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.634915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.635015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.635096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.635266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.635433] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.635546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.635627] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.635798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.635895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.635998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.636441] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.127165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.127165] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf with status ACTIVE [ 1196.127165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.127165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.127165] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.127165] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.127866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.127866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.127866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.127866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.127866] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf is going to be updated. [ 1196.138519] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5c29d6f-7489-45e1-8183-08f2d7095d33: rpc.has_security_group_logging(os_id): False [ 1196.147624] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.147774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.147814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.148063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.148191] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.148250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f1f8afc-e79b-46bd-9c58-0dc0ad4c58cf" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.153066] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.153216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.153279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.153393] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.153474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.153641] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.153728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.153789] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.153931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.154019] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.154208] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.154300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.154358] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.154498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.154570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.154758] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.154848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.154899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.155052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.155127] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.155223] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1196.209947] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.210122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.210197] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.210365] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.210513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.235510] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1196.615870] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1196.616325] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1196.616325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.616423] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.616576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.616765] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.616887] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.617106] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.617308] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.617431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.617537] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.120325] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.613335] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1197.613551] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.613743] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.614027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.614302] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.614451] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.614547] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.614734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.614869] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.614978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.615114] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.623837] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.118052] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.118240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.118240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.118448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.118613] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.118716] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.118804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.118973] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.119073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.119164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.119322] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.119468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.119534] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.119680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.119823] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.119933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.119994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.120148] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.120227] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.120317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.120394] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.125955] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.126078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.126143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.126293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.126375] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.126469] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1198.153456] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.153586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.153636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.153815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.153954] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.161573] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1198.248178] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1198.248503] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.622488] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7e639c-697c-438d-b550-983a53fa2d55: rpc.has_security_group_logging(os_id): False [ 1198.642167] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.642587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.642587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.642587] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.642741] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.642827] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.642931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.642987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.643164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.643247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.643453] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.643545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.643608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.643774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.643873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.644075] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.644170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.644232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.644373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.644446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.644530] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1198.729977] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.730189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.730280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.730484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.730662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.745590] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1200.173930] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1200.174282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.174362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.174572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.174771] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.174884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.174951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.175124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.175206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.175290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.175383] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.619187] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.619357] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1200.678148] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.678366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.678366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.678586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.678758] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.678898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.678965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.679171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.679262] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.679349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.679503] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.679592] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.679676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.679916] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.680184] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.680347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.680443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.680602] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.680684] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.680769] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.680863] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.758984] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1200.759256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.183034] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b49a7f5-6ed4-481f-81ba-d9ed36714c01: rpc.has_security_group_logging(os_id): False [ 1201.200949] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.201169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.201287] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.201575] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.201708] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.202043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.202199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.202300] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.202556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.202654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.202938] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.203109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.203206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.203425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.203549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.203830] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.203982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.204101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.204441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.204441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.204555] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1201.273843] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.274030] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.274080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.274283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.274424] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.286549] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1202.355538] env[63014]: INFO networking_nsxv3.common.synchronization [req-ed8ae406-9828-40f0-99f6-b0e688b0bb3e req-0c626372-1f2e-4eb2-aac6-4ab2cbe6bcac tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1202.356122] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1202.356440] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.356565] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.356637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.356936] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.356990] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.357155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.357155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.357315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.357399] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.357488] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.860182] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.299132] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1203.299416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.362088] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.865800] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.866024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.866024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.866250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.866342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.866440] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1203.911948] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.912140] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.912213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.912408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.912513] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.920977] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1205.931728] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1205.932114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.359380] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.359901] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1209.104284] env[63014]: INFO networking_nsxv3.common.synchronization [None req-1e2d788a-3fcd-470c-964b-3041eb8a6f9c tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_rules [ 1209.104760] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_rules [ 1209.105082] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83bed21a-0cd7-4bab-99c0-976f78b22b51 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.105210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.105279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.105591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.105642] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.296369] env[63014]: INFO networking_nsxv3.common.synchronization [None req-a3562709-7111-4bfe-89a4-77e72b554b92 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_rules [ 1209.296905] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_rules [ 1209.297307] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83bed21a-0cd7-4bab-99c0-976f78b22b51 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.297417] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.510975] env[63014]: INFO networking_nsxv3.common.synchronization [req-2dd64d60-66d8-4f8a-beaa-1ff8c4bb871c req-34672f40-9d2c-4da0-a334-a4a6727c85bc tempest-ServersTestJSON-1105168545 tempest-ServersTestJSON-1105168545-project-member] Enqueued Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1209.511555] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 with Priority: HIGHEST for action security_group_members [ 1209.516009] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5c29d6f-7489-45e1-8183-08f2d7095d33 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.516157] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.516277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.520022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.520022] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.520022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.520022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.520022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.520022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.520022] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5c29d6f-7489-45e1-8183-08f2d7095d33',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.625132] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.625286] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.625340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.625582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.625703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.625814] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 already deleted. [ 1209.625907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.626071] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.626247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.626329] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.795794] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-849 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.796057] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.796157] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.796434] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.798326] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.798561] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.798697] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.798932] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.799127] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.799347] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.799467] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.799609] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.799691] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.799807] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1209.799916] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.800101] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.816782] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.816941] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1209.817609] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.817609] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-849" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.817609] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-851e3de9-9bb9-44fe-abee-b7031409f089 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.817818] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.817818] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.818064] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.818236] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('851e3de9-9bb9-44fe-abee-b7031409f089',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.022419] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.022578] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.022654] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.022952] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.023063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.023276] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.023378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.023441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.023601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.023680] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.023772] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 is going to be updated. [ 1210.048055] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.048199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.048252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.048442] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.048580] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.055939] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: IN_PROGRESS for 2s [ 1210.149924] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.149924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.149924] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.150304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.150304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.150304] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 already deleted. [ 1210.150394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.321089] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.321349] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.321483] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.321808] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.321962] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.322330] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.322518] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.322649] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.322890] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.323040] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.323340] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.323503] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.323627] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.323847] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.323993] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.324746] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 851e3de9-9bb9-44fe-abee-b7031409f089 is going to be updated. [ 1210.343237] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.343571] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.343711] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.344028] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.344229] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.344496] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.027313] env[63014]: INFO networking_nsxv3.common.synchronization [req-78542bd4-a789-481d-bc7a-61f7d3e782a0 req-e4592617-07e5-44c7-abb0-8e4a2c693a44 service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 1211.027313] env[63014]: INFO networking_nsxv3.common.synchronization [req-78542bd4-a789-481d-bc7a-61f7d3e782a0 req-e4592617-07e5-44c7-abb0-8e4a2c693a44 service nova] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1211.027313] env[63014]: INFO networking_nsxv3.common.synchronization [req-78542bd4-a789-481d-bc7a-61f7d3e782a0 req-e4592617-07e5-44c7-abb0-8e4a2c693a44 service nova] Enqueued Resource ID: 851e3de9-9bb9-44fe-abee-b7031409f089 with Priority: HIGHEST for action port [ 1211.027313] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_rules [ 1211.027313] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1211.027313] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851e3de9-9bb9-44fe-abee-b7031409f089 with Priority: HIGHEST for action port [ 1211.027313] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.027313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.027739] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.028282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.028515] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.030416] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.030744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.031207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.031497] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.032087] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.032312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.032514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.032756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.032933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.033114] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.036311] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-851e3de9-9bb9-44fe-abee-b7031409f089 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.036311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.036311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.036311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.036311] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('851e3de9-9bb9-44fe-abee-b7031409f089',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.530974] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.531421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.535762] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.540082] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 851e3de9-9bb9-44fe-abee-b7031409f089 with status ACTIVE [ 1211.540312] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.541289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.541289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.541422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.542408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.542408] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.542408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.542408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.542408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.542408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.542408] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.542756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.542756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.542832] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.542956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.543119] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 851e3de9-9bb9-44fe-abee-b7031409f089 is going to be updated. [ 1211.563025] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.563025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.563025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.563025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.563025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.563025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-851e3de9-9bb9-44fe-abee-b7031409f089" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.037518] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.064835] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 in Status: SUCCESS [ 1212.064835] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5c29d6f-7489-45e1-8183-08f2d7095d33 deletion is rescheduled due to dependency. [ 1212.065014] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5c29d6f-7489-45e1-8183-08f2d7095d33" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.540994] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.541539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.541539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.541539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.541539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.541539] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1212.569283] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.569460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.569460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.569625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.569766] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.577640] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1214.588879] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 4s [ 1215.874386] env[63014]: INFO networking_nsxv3.common.synchronization [req-fec606f4-6f78-46f9-b121-03832d218d70 req-6121b955-f84a-4ba6-a0ca-214bd83dfcd5 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_members [ 1215.875214] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_members [ 1215.875330] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bed21a-0cd7-4bab-99c0-976f78b22b51 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.875457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.875525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.875779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.875936] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.876290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.876374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.876571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.876623] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.876755] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.202670] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.202903] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.203011] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.203398] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.203691] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.203857] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.203980] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.204237] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.204382] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.204596] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.204713] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1216.204825] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1216.204930] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1216.205054] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1216.205166] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1216.205307] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1216.223131] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1216.223624] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1216.223624] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1216.223624] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.223965] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-32af5aea-dc23-4102-9778-9f4e9df869d7 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.224237] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-32af5aea-dc23-4102-9778-9f4e9df869d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.224326] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-32af5aea-dc23-4102-9778-9f4e9df869d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.224707] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-32af5aea-dc23-4102-9778-9f4e9df869d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.224845] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32af5aea-dc23-4102-9778-9f4e9df869d7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.380092] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.380291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.380332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.380542] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.380636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.380882] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.380989] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.381064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.381231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.381313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.381401] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 already deleted. [ 1216.381483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.602024] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1216.602024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.602024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.602024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.602024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.602342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.602342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.602342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.602457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.603027] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.603027] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.728014] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.728303] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.728450] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.728873] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.728983] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.729189] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 32af5aea-dc23-4102-9778-9f4e9df869d7 not found, creating... [ 1216.729537] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.729733] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.729924] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.730269] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.730478] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.730843] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.731048] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.731225] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.731541] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.731759] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.731962] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 32af5aea-dc23-4102-9778-9f4e9df869d7 is going to be created. [ 1216.752154] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.753238] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.753238] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.753238] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.753238] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.753376] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-32af5aea-dc23-4102-9778-9f4e9df869d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.104915] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.105297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.105297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.105410] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.105620] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.105703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.105703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.106053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.106053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.106053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.106226] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.106294] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.106342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.106753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.106753] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.106753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.106753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.106982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.106982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.106982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.107516] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.446316] env[63014]: INFO networking_nsxv3.common.synchronization [req-fec606f4-6f78-46f9-b121-03832d218d70 req-1576889c-2082-4c84-ad4f-2eb437c9d42b service nova] Enqueued Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_rules [ 1217.446509] env[63014]: INFO networking_nsxv3.common.synchronization [req-fec606f4-6f78-46f9-b121-03832d218d70 req-1576889c-2082-4c84-ad4f-2eb437c9d42b service nova] Enqueued Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_members [ 1217.446653] env[63014]: INFO networking_nsxv3.common.synchronization [req-fec606f4-6f78-46f9-b121-03832d218d70 req-1576889c-2082-4c84-ad4f-2eb437c9d42b service nova] Enqueued Resource ID: 32af5aea-dc23-4102-9778-9f4e9df869d7 with Priority: HIGHEST for action port [ 1217.446879] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_rules [ 1217.447038] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_members [ 1217.447160] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32af5aea-dc23-4102-9778-9f4e9df869d7 with Priority: HIGHEST for action port [ 1217.447743] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83bed21a-0cd7-4bab-99c0-976f78b22b51 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.447959] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.448041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.448252] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.448333] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.449370] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bed21a-0cd7-4bab-99c0-976f78b22b51 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.449370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.449370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.449539] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.449721] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.449787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.449787] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.449934] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.449998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.450094] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.451031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-32af5aea-dc23-4102-9778-9f4e9df869d7 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.451031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32af5aea-dc23-4102-9778-9f4e9df869d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.451031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32af5aea-dc23-4102-9778-9f4e9df869d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.451228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32af5aea-dc23-4102-9778-9f4e9df869d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.451228] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32af5aea-dc23-4102-9778-9f4e9df869d7',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.608982] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7e639c-697c-438d-b550-983a53fa2d55: rpc.has_security_group_logging(os_id): False [ 1217.625829] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.626025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.626025] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.626247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.626352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.626537] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.626637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.626701] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.626858] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.626940] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.627175] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.627276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.627340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.627489] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.627566] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.627746] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.627840] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.627905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.628055] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.628131] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.628217] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1217.684353] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.684501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.685210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.685210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.685210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.696422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1217.953030] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bed21a-0cd7-4bab-99c0-976f78b22b51 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.953147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.953301] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.954917] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32af5aea-dc23-4102-9778-9f4e9df869d7 with status ACTIVE [ 1217.955118] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.955232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.955304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.955512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.955603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.955963] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.955963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.955963] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.956142] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.956177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.956344] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.956431] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.956488] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.956629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.956703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.956783] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32af5aea-dc23-4102-9778-9f4e9df869d7 is going to be updated. [ 1217.979893] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.980078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.980153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.980289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.980420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.980572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32af5aea-dc23-4102-9778-9f4e9df869d7" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.455896] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.958347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.958509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.958615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.958857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.959220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.959220] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 is going to be created. [ 1218.981166] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.981318] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.981389] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.981597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.981755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.990110] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 in Status: UNINITIALIZED for 2s [ 1219.708749] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1219.709076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.999693] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 in Status: SUCCESS [ 1221.000139] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.000208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.000457] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.000682] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.000806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.000873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.001122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.001315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.001388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.001459] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.503922] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.007141] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83bed21a-0cd7-4bab-99c0-976f78b22b51: rpc.has_security_group_logging(os_id): False [ 1222.026957] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.027089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.027180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.027427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.027526] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.027772] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.027872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.027935] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.028101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.028186] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.028290] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 is going to be created. [ 1222.086901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.087074] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.087168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.087453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.087644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.101518] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 in Status: IN_PROGRESS for 2s [ 1222.448874] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1222.448874] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1223.322853] env[63014]: INFO networking_nsxv3.common.synchronization [req-d11b23b7-7954-4ca8-9fc3-6c35f7979e80 req-64678f22-e91e-4952-abfc-9d75b15ac01e tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1223.328031] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1223.328031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.328031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.328031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.328031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.328031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.328031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.328031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.328031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.328031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.328031] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.359018] env[63014]: INFO networking_nsxv3.common.synchronization [req-d11b23b7-7954-4ca8-9fc3-6c35f7979e80 req-64678f22-e91e-4952-abfc-9d75b15ac01e tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1223.359018] env[63014]: INFO networking_nsxv3.common.synchronization [req-d11b23b7-7954-4ca8-9fc3-6c35f7979e80 req-64678f22-e91e-4952-abfc-9d75b15ac01e tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1223.359018] env[63014]: INFO networking_nsxv3.common.synchronization [req-d11b23b7-7954-4ca8-9fc3-6c35f7979e80 req-64678f22-e91e-4952-abfc-9d75b15ac01e tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: f2f27209-06cc-4e48-a2dc-106b07680907 with Priority: HIGHEST for action port [ 1223.359788] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1223.360180] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1223.360411] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f27209-06cc-4e48-a2dc-106b07680907 with Priority: HIGHEST for action port [ 1223.361274] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.363031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.363031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.363031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.363031] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.363031] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.363031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.365187] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f27209-06cc-4e48-a2dc-106b07680907 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.365187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.365187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.365187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.365187] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f27209-06cc-4e48-a2dc-106b07680907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.830051] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.865387] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.865546] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.868875] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2f27209-06cc-4e48-a2dc-106b07680907 with status ACTIVE [ 1223.869079] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.869199] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.869315] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.869530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.869621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.869837] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.869950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.870034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.870237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.870340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.870548] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.870651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.870728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.870903] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.870988] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.871107] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2f27209-06cc-4e48-a2dc-106b07680907 is going to be updated. [ 1223.892893] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.893108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.893215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.893435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.893817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.893817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.115580] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 in Status: SUCCESS [ 1224.115784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.332153] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.501306] env[63014]: INFO networking_nsxv3.common.synchronization [req-d5be1749-b72b-48eb-adb9-15c9e4e08f5d req-fcd55eb1-8487-489e-abe5-3eaee79bb2ac tempest-ServerActionsTestOtherB-7425835 tempest-ServerActionsTestOtherB-7425835-project-member] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1224.501857] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1224.502901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.502901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.502901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.502901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.502901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.502901] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.503275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.503804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.503804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.504831] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.834726] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.835053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.835053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.835232] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.835340] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.835397] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be updated. [ 1224.862988] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.863397] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.863518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.863798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.864060] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.873946] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: IN_PROGRESS for 2s [ 1225.006159] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.007313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.007313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.007313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.007313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.007313] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.007313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.007313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.007313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.007313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.007786] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1225.034842] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.034979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.035057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.035259] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.035402] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.043794] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1225.876120] env[63014]: INFO networking_nsxv3.common.synchronization [req-85847463-eb0d-482e-bd9c-b2bd2830962b req-6167e0d4-c908-4fd6-b651-4fcae2cb1745 tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1225.876656] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1225.876959] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.877087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.901787] env[63014]: INFO networking_nsxv3.common.synchronization [req-85847463-eb0d-482e-bd9c-b2bd2830962b req-6167e0d4-c908-4fd6-b651-4fcae2cb1745 tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1225.902040] env[63014]: INFO networking_nsxv3.common.synchronization [req-85847463-eb0d-482e-bd9c-b2bd2830962b req-6167e0d4-c908-4fd6-b651-4fcae2cb1745 tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1225.902223] env[63014]: INFO networking_nsxv3.common.synchronization [req-85847463-eb0d-482e-bd9c-b2bd2830962b req-6167e0d4-c908-4fd6-b651-4fcae2cb1745 tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: f2f27209-06cc-4e48-a2dc-106b07680907 with Priority: HIGHEST for action port [ 1225.902837] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_rules [ 1225.902995] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1225.903134] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f27209-06cc-4e48-a2dc-106b07680907 with Priority: HIGHEST for action port [ 1225.903517] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.903634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.903879] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.903999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.904242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f27209-06cc-4e48-a2dc-106b07680907 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.904359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.904453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.904733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.904832] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f27209-06cc-4e48-a2dc-106b07680907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.409784] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2f27209-06cc-4e48-a2dc-106b07680907 with status ACTIVE [ 1226.410076] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.410224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.410342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.410644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.410746] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.410950] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.411094] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.411178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.411364] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.411448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.411659] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.411800] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.411880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.412066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.412152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.412284] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2f27209-06cc-4e48-a2dc-106b07680907 is going to be updated. [ 1226.431398] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.431633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.431633] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.431843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.431981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.432168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f27209-06cc-4e48-a2dc-106b07680907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.883055] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: SUCCESS [ 1226.883588] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.883707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.883835] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.884206] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.884337] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.884553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.884736] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.884889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.885017] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.053265] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1227.053530] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 deletion is rescheduled due to dependency. [ 1227.053676] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.388258] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.872439] env[63014]: INFO networking_nsxv3.common.synchronization [req-951e1a90-5d7b-4142-80df-9da5c80ee7c5 req-4669dba2-b250-49fd-9e72-ab629ca48ae2 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1227.872969] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1227.873312] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.874057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.874057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.874057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.874228] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.874228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.874228] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.874426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.874468] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.874552] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.890694] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.377446] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.393662] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.393868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.393868] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.394109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.394399] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.394399] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be updated. [ 1228.422239] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.422596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.422596] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.422675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.422816] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.430788] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: IN_PROGRESS for 2s [ 1228.879751] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.382089] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.382089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.382089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.382498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.382498] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.382498] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f4789b-3196-4067-98ab-735a7770f947 is going to be updated. [ 1229.409957] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.410147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.410147] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.410382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.410555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.419521] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: IN_PROGRESS for 2s [ 1229.615962] env[63014]: INFO networking_nsxv3.common.synchronization [req-6d91f18b-ada7-4604-9e1c-2a8d28e5d028 req-07e683a9-d8d2-4419-ac7c-b6f5528bc0a8 tempest-AttachInterfacesUnderV243Test-1566335021 tempest-AttachInterfacesUnderV243Test-1566335021-project-member] Enqueued Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1229.616500] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd050717-3504-424f-943d-0714073722e0 with Priority: HIGHEST for action security_group_members [ 1229.616805] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd050717-3504-424f-943d-0714073722e0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.616911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.990503] env[63014]: INFO networking_nsxv3.common.synchronization [req-868dc987-a65d-4609-800a-f91b41afa1c6 req-bd0238b3-0083-4155-815f-beac5213e3eb tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1229.991031] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1229.991393] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.991528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.991595] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.992555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.992722] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.992826] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.992889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.993059] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.993145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.993241] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.440249] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: SUCCESS [ 1230.440620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.440620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.440843] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.441110] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.441182] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.441220] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.441386] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.441474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.441553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.441657] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.442510] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.442678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.442833] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.442927] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.442987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.443154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.443235] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.443322] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.497973] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.498255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.498369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.498703] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.498853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.499196] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.499380] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.499470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.499690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.499823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.499967] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1230.543618] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.543889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.543889] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.544168] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.544357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.553760] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1230.765607] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1230.765812] env[63014]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-baa814fb-e0c8-4884-940d-c194e94f40c8 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1230.945462] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.947043] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.947207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.947207] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.947403] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.947509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.947898] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.947898] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.947997] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.948162] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.948281] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.948419] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be updated. [ 1230.973409] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.973557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.973614] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.973818] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.973960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.983578] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: IN_PROGRESS for 2s [ 1231.429775] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: SUCCESS [ 1231.430087] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.451073] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd050717-3504-424f-943d-0714073722e0: rpc.has_security_group_logging(os_id): False [ 1231.469332] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.469631] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.469710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.469920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.470029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.470291] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.470412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.470499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.470679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.470752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.470869] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be updated. [ 1231.527737] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.528879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.528879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.528879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.528879] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.540550] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd050717-3504-424f-943d-0714073722e0 in Status: IN_PROGRESS for 2s [ 1232.562895] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1232.563219] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c deletion is rescheduled due to dependency. [ 1232.563219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.993595] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: SUCCESS [ 1232.993894] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 deletion is rescheduled due to dependency. [ 1232.994080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.994529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.994644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.994921] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.995151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.995238] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.995360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.995449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.995782] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.498624] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.498624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.498624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.498862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.498862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.499075] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.499189] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.499266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.499496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.499590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.499692] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be updated. [ 1233.524433] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.524669] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.524742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.524944] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.525178] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.540025] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: IN_PROGRESS for 2s [ 1233.551636] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dd050717-3504-424f-943d-0714073722e0 in Status: SUCCESS [ 1233.551878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.551998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.552251] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.552338] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.013374] env[63014]: INFO networking_nsxv3.common.synchronization [req-803c5304-3124-41cd-b0ca-c8963d6a26bf req-95ee5a4c-0433-4f71-beb0-411f7bd24724 tempest-DeleteServersTestJSON-2102368593 tempest-DeleteServersTestJSON-2102368593-project-member] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1234.013916] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGHEST for action security_group_members [ 1234.014255] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.014394] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.014474] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.014730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.014921] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.014982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.015028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.015204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.015279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.015362] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.074221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.074435] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.074556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.074845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.074969] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.075122] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be deleted. [ 1234.129302] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.129550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.129665] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.129885] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.129977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.130117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.518176] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.519222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.519222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.519222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.519222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.519222] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.519516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.519516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.519987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.519987] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.519987] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be updated. [ 1234.546871] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.547048] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.547133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.547317] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.547470] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.556706] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: IN_PROGRESS for 2s [ 1235.332275] env[63014]: INFO networking_nsxv3.common.synchronization [req-7a11cf4b-5bba-46e6-8787-b5e82864427d req-bd369eec-6bd7-471b-9f9a-0a26d0178114 tempest-ServerActionsTestOtherB-7425835 tempest-ServerActionsTestOtherB-7425835-project-member] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1235.332968] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1235.333756] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.333875] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.333981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.334298] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.334503] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.334668] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.334732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.334928] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.335101] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.335229] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.550266] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd050717-3504-424f-943d-0714073722e0 in Status: SUCCESS [ 1235.552145] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 deletion is rescheduled due to dependency. [ 1235.552145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.552145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.552145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.552145] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.552145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.552145] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.552612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.552745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.552874] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd050717-3504-424f-943d-0714073722e0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.838034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.838268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.838377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.838667] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.838805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.839103] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.839247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.839342] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.839579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.839693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.839817] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1235.863668] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.863995] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.864196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.864571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.864851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.873501] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1235.886883] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.887246] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.887529] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.887958] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.888427] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.888816] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.889098] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.889560] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.889826] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.890218] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.890477] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.890730] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.890986] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.891259] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1235.891465] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.891710] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.908566] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.908795] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1235.908988] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.909245] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.909680] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-11435eed-984e-4e61-8df9-637c3b31098f taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.909928] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.910131] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.910548] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.910748] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11435eed-984e-4e61-8df9-637c3b31098f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.060524] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.060711] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.060786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.060998] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.061109] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.061317] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.061416] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.061481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.061634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.061714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.061827] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd050717-3504-424f-943d-0714073722e0 is going to be deleted. [ 1236.083068] env[63014]: INFO networking_nsxv3.common.synchronization [req-334bee20-5cac-4e34-93c3-e4cb29a4f5ce req-7cf14176-d272-4c37-9eb3-dfed4604d3ae tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1236.085082] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64f4789b-3196-4067-98ab-735a7770f947 with Priority: HIGHEST for action security_group_members [ 1236.085082] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-64f4789b-3196-4067-98ab-735a7770f947 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.085082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.085082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.085082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.085082] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.085082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.085082] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.085449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.085449] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.085449] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64f4789b-3196-4067-98ab-735a7770f947',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.088459] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.088549] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.088651] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.088863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.088979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.089111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd050717-3504-424f-943d-0714073722e0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.413515] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.413924] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.413924] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.414142] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.414301] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.414469] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 11435eed-984e-4e61-8df9-637c3b31098f not found, creating... [ 1236.414747] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.414910] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.415044] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.415287] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.415423] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.415707] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.415869] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.415990] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.416217] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.416357] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.416499] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 11435eed-984e-4e61-8df9-637c3b31098f is going to be created. [ 1236.444177] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.444398] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.444483] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.444734] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.444960] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.445207] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.568049] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 in Status: SUCCESS [ 1236.568049] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 deletion is rescheduled due to dependency. [ 1236.568239] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.587679] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.587822] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.587932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.588146] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.588240] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.588438] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.588555] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.588620] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.588774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.588842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.588931] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f4789b-3196-4067-98ab-735a7770f947 is going to be updated. [ 1236.619555] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.619731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.619731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.620793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.620793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.631933] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: IN_PROGRESS for 2s [ 1237.117089] env[63014]: INFO networking_nsxv3.common.synchronization [req-7a11cf4b-5bba-46e6-8787-b5e82864427d req-727cca67-f4a7-47d5-8a89-1a3458fb1d65 service nova] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 1237.117089] env[63014]: INFO networking_nsxv3.common.synchronization [req-7a11cf4b-5bba-46e6-8787-b5e82864427d req-727cca67-f4a7-47d5-8a89-1a3458fb1d65 service nova] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1237.117089] env[63014]: INFO networking_nsxv3.common.synchronization [req-7a11cf4b-5bba-46e6-8787-b5e82864427d req-727cca67-f4a7-47d5-8a89-1a3458fb1d65 service nova] Enqueued Resource ID: 11435eed-984e-4e61-8df9-637c3b31098f with Priority: HIGHEST for action port [ 1237.117089] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 1237.117089] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1237.117089] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11435eed-984e-4e61-8df9-637c3b31098f with Priority: HIGHEST for action port [ 1237.117089] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.117089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.117089] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.118154] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.118301] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.119412] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.119514] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.119786] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-11435eed-984e-4e61-8df9-637c3b31098f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.119899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.119899] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.120093] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.120151] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11435eed-984e-4e61-8df9-637c3b31098f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.622191] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.622483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.622525] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11435eed-984e-4e61-8df9-637c3b31098f with status ACTIVE [ 1237.622682] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.622783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.622845] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.623068] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.623153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.623717] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.623717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.623717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.623717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.623717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.623970] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.623970] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.624057] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.624325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.624325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.624325] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11435eed-984e-4e61-8df9-637c3b31098f is going to be updated. [ 1237.644180] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.644361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.644361] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.644610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.644776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.644979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.883341] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1237.883522] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 deletion is rescheduled due to dependency. [ 1237.883637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.887280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.887458] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.887667] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.887790] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.887863] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.888034] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.888143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.888218] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.392123] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.642236] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64f4789b-3196-4067-98ab-735a7770f947 in Status: SUCCESS [ 1238.642236] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64f4789b-3196-4067-98ab-735a7770f947 deletion is rescheduled due to dependency. [ 1238.642236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64f4789b-3196-4067-98ab-735a7770f947" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.897135] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.399926] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.400244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.400244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.401031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.401031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.401031] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1239.431517] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.431807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.431807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.432016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.432170] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.441182] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1240.108632] env[63014]: INFO networking_nsxv3.common.synchronization [None req-764a6296-d48c-47cd-adbe-b1b23a6c3ed7 tempest-AttachInterfacesTestJSON-1679306187 tempest-AttachInterfacesTestJSON-1679306187-project-member] Enqueued Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1240.109234] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7e639c-697c-438d-b550-983a53fa2d55 with Priority: HIGHEST for action security_group_members [ 1240.109561] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7e639c-697c-438d-b550-983a53fa2d55 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.109686] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.109754] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.109955] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.110115] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.110209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.110264] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.110408] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.110492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.110592] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7e639c-697c-438d-b550-983a53fa2d55',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.613120] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.613283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.613345] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.613572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.613733] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.613965] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.614128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.614229] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.614411] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.614495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.614588] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 is going to be updated. [ 1240.642957] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.643122] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.643219] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.643422] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.643572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.651227] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: IN_PROGRESS for 2s [ 1241.452999] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1241.452999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.452999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.452999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.452999] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.452999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.452999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.452999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.452999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.452999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.452999] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.955069] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.457685] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db110989-027c-4ed8-b5db-6b256912c344: rpc.has_security_group_logging(os_id): False [ 1242.474622] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.474776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.474851] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.475067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.475164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.475447] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.475524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.475584] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.475718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.475796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.475882] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1242.532256] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.532256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.532256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.532256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.532256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.545472] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1242.661088] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7e639c-697c-438d-b550-983a53fa2d55 in Status: SUCCESS [ 1242.661088] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7e639c-697c-438d-b550-983a53fa2d55 deletion is rescheduled due to dependency. [ 1242.661466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7e639c-697c-438d-b550-983a53fa2d55" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.320218] env[63014]: INFO networking_nsxv3.common.synchronization [req-4b6bded6-2cea-4eef-b633-2efde1a159f9 req-7412e5b7-9292-44ee-8025-31c5439cb037 tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1243.320764] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1243.321081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.321204] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.321268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.321464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.321614] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.321724] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.321786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.321931] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.322026] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.322120] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.627969] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-812 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.628289] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.628339] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.628573] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.628827] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.628986] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.629119] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.629338] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.629484] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.629730] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.629855] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1243.629978] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1243.630105] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1243.630220] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1243.630328] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1243.630463] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1243.652149] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1243.652278] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1243.652422] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1243.652586] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-812" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.652866] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-1e5d3b95-07cc-4718-a77c-8d0b3e212621 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.653039] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-1e5d3b95-07cc-4718-a77c-8d0b3e212621" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.653167] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-1e5d3b95-07cc-4718-a77c-8d0b3e212621" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.653468] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-1e5d3b95-07cc-4718-a77c-8d0b3e212621" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.653713] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e5d3b95-07cc-4718-a77c-8d0b3e212621',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.824761] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.824993] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.825108] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.825379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.825479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.825694] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.825813] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.825877] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.826052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.826177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.826225] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1243.852577] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.852762] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.852806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.853075] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.853187] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.862743] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1244.156534] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.156823] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.156872] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.157155] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.157318] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.157495] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 1e5d3b95-07cc-4718-a77c-8d0b3e212621 not found, creating... [ 1244.157775] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.157941] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.158076] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.158305] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.158451] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.158735] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.158897] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.159036] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.159256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.159398] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.159541] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 1e5d3b95-07cc-4718-a77c-8d0b3e212621 is going to be created. [ 1244.182548] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.182773] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.183218] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.183218] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.183413] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.183637] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-1e5d3b95-07cc-4718-a77c-8d0b3e212621" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.556653] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1244.557155] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.851285] env[63014]: INFO networking_nsxv3.common.synchronization [req-4b6bded6-2cea-4eef-b633-2efde1a159f9 req-61fdc56b-9f52-4e4b-b71e-d543b722d629 service nova] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 1244.851544] env[63014]: INFO networking_nsxv3.common.synchronization [req-4b6bded6-2cea-4eef-b633-2efde1a159f9 req-61fdc56b-9f52-4e4b-b71e-d543b722d629 service nova] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1244.851661] env[63014]: INFO networking_nsxv3.common.synchronization [req-4b6bded6-2cea-4eef-b633-2efde1a159f9 req-61fdc56b-9f52-4e4b-b71e-d543b722d629 service nova] Enqueued Resource ID: 1e5d3b95-07cc-4718-a77c-8d0b3e212621 with Priority: HIGHEST for action port [ 1244.853634] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_rules [ 1244.853634] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1244.853634] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e5d3b95-07cc-4718-a77c-8d0b3e212621 with Priority: HIGHEST for action port [ 1244.853634] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.853634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.853634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.853634] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.853634] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.855553] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.855553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.855745] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e5d3b95-07cc-4718-a77c-8d0b3e212621 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.855865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e5d3b95-07cc-4718-a77c-8d0b3e212621" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.856292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e5d3b95-07cc-4718-a77c-8d0b3e212621" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.856292] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e5d3b95-07cc-4718-a77c-8d0b3e212621" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.856292] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e5d3b95-07cc-4718-a77c-8d0b3e212621',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.357707] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.357893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.358119] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e5d3b95-07cc-4718-a77c-8d0b3e212621 with status ACTIVE [ 1245.358297] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.358405] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.358467] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.358675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.358767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.358947] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.359110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.359217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.359413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.359535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.359715] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.359814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.359874] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.360031] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.360110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.360194] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e5d3b95-07cc-4718-a77c-8d0b3e212621 is going to be updated. [ 1245.380151] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.380299] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.380373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.380571] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.380705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.380859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e5d3b95-07cc-4718-a77c-8d0b3e212621" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.874013] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1245.874388] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c deletion is rescheduled due to dependency. [ 1245.874388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.874484] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.874655] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.874864] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.874980] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.875054] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.875221] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.875325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.875391] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.377422] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.879954] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.382811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.382811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.382811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.383102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.383102] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.383102] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1247.416173] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.416453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.416535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.416909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.417052] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.424999] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1249.435640] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1249.436085] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.436200] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.436501] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.436724] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.436849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.436939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.437100] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.437188] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.437276] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.437368] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.853418] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1249.853581] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1249.940164] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.442041] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9141a736-220e-4a6b-b407-916c87c8099c: rpc.has_security_group_logging(os_id): False [ 1250.459385] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.459531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.459531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.459710] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.459804] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.460062] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.460163] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.460349] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.460400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.460460] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.460547] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1250.516064] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.516213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.516260] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.516426] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.516563] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.533260] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1252.546267] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1252.546690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.854440] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.854828] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1259.855718] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1259.856096] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1264.856666] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.857143] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1265.234731] env[63014]: INFO networking_nsxv3.common.synchronization [req-b98936dd-fc0c-4a44-9c62-d1ad12b9a79e req-3d6b132d-ad3c-4d56-ad50-64f57bde6041 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_members [ 1265.235580] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 with Priority: HIGHEST for action security_group_members [ 1265.235580] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-83bed21a-0cd7-4bab-99c0-976f78b22b51 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.235778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.235778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.236520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.236520] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.236520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.236520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.236520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.236520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.237258] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83bed21a-0cd7-4bab-99c0-976f78b22b51',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.740902] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.741128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.741128] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.741346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.741439] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.741645] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.741744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.741805] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.741953] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.742042] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.742151] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 is going to be updated. [ 1265.769381] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.769557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.769557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.769718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.769846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.777434] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 in Status: IN_PROGRESS for 2s [ 1267.788830] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 in Status: SUCCESS [ 1267.789243] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83bed21a-0cd7-4bab-99c0-976f78b22b51 deletion is rescheduled due to dependency. [ 1267.789243] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83bed21a-0cd7-4bab-99c0-976f78b22b51" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.235860] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.236285] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1275.237214] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.237486] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1276.661232] env[63014]: INFO networking_nsxv3.common.synchronization [req-cf92bd22-259a-41ef-b9a3-9b34268dafc4 req-01f9a892-f02e-4e49-aa10-e526e9b75d17 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_members [ 1276.661781] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 with Priority: HIGHEST for action security_group_members [ 1276.662093] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-c37e051e-8989-4b52-b4f6-04f6b7301ee0 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.662222] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.662290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.662520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.662670] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.662767] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.662878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.662982] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.663096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.663205] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c37e051e-8989-4b52-b4f6-04f6b7301ee0',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.165565] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.165859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.165859] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.165999] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.166096] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.166307] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.166419] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.166476] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.166612] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.166689] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.166778] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 is going to be updated. [ 1277.194239] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.194529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.194529] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.194653] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.194776] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.202980] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 in Status: IN_PROGRESS for 2s [ 1279.214748] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 in Status: SUCCESS [ 1279.215135] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c37e051e-8989-4b52-b4f6-04f6b7301ee0 deletion is rescheduled due to dependency. [ 1279.215135] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c37e051e-8989-4b52-b4f6-04f6b7301ee0" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.179472] env[63014]: INFO networking_nsxv3.common.synchronization [None req-8a338e20-4e6e-4579-9579-390a7f6807e6 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_rules [ 1281.180016] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_rules [ 1281.180197] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.180341] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.180413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.180691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.180777] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.242416] env[63014]: INFO networking_nsxv3.common.synchronization [None req-d4b6b532-eb1d-409b-83c9-eda30ecd09e9 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_rules [ 1281.242670] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_rules [ 1281.243189] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.243297] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.702811] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.703022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.703078] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.703258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.703347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.703464] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb already deleted. [ 1281.703558] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.703704] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.703857] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.703938] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.223729] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.224035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.224035] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.224159] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.224268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.224371] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb already deleted. [ 1282.224455] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.243518] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.243840] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.508285] env[63014]: INFO networking_nsxv3.common.synchronization [req-1c9a9950-0fb4-4c2b-897a-13e2042b3ef1 req-40649f35-5bb1-48a0-95cb-3887957f55cc tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_members [ 1286.508802] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_members [ 1286.509120] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c81574f-ed38-45ed-b9ab-6228b9f22efb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.509244] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.509311] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.509562] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.509719] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.509862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.509862] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.510437] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.510572] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.510672] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.821547] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.821785] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.821916] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.822246] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.822525] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.822715] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.822856] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.823110] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.823387] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.823514] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1286.823644] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1286.823772] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1286.823895] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1286.824020] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1286.824133] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1286.824292] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1286.845271] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1286.845271] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1286.845475] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1286.845625] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.845962] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.846197] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.846311] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.846668] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.846832] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936ed056-e8e6-49f2-9821-9d2c5ac3e7af',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.016515] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.016815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.016815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.016968] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.017076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.017283] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.017377] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.017434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.017597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.017675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.017764] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb already deleted. [ 1287.017848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.350107] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.350107] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.350107] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.350107] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.350107] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.350901] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 936ed056-e8e6-49f2-9821-9d2c5ac3e7af not found, creating... [ 1287.350901] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.350901] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.350901] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.351168] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.351234] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.351484] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.351645] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.351769] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.351981] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.352133] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.352281] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 936ed056-e8e6-49f2-9821-9d2c5ac3e7af is going to be created. [ 1287.372059] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.372240] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.372368] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.372604] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.372826] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.373054] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.055806] env[63014]: INFO networking_nsxv3.common.synchronization [req-1c9a9950-0fb4-4c2b-897a-13e2042b3ef1 req-8b64d467-c31b-4728-a4c2-cf9b38219bf0 service nova] Enqueued Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_rules [ 1288.056030] env[63014]: INFO networking_nsxv3.common.synchronization [req-1c9a9950-0fb4-4c2b-897a-13e2042b3ef1 req-8b64d467-c31b-4728-a4c2-cf9b38219bf0 service nova] Enqueued Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_members [ 1288.056180] env[63014]: INFO networking_nsxv3.common.synchronization [req-1c9a9950-0fb4-4c2b-897a-13e2042b3ef1 req-8b64d467-c31b-4728-a4c2-cf9b38219bf0 service nova] Enqueued Resource ID: 936ed056-e8e6-49f2-9821-9d2c5ac3e7af with Priority: HIGHEST for action port [ 1288.056498] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_rules [ 1288.056572] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_members [ 1288.056666] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 936ed056-e8e6-49f2-9821-9d2c5ac3e7af with Priority: HIGHEST for action port [ 1288.057521] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.057653] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.057720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.057938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.058008] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.060034] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c81574f-ed38-45ed-b9ab-6228b9f22efb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.060171] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.060213] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.060415] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.060691] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.060798] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.060860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.061215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.061215] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.061215] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.062580] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.062691] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.062770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.063041] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.063122] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('936ed056-e8e6-49f2-9821-9d2c5ac3e7af',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.560997] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c81574f-ed38-45ed-b9ab-6228b9f22efb taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.561363] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.563494] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.564365] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 936ed056-e8e6-49f2-9821-9d2c5ac3e7af with status ACTIVE [ 1288.564548] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.564660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.564727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.564920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.565022] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.565195] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.565293] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.565357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.565505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.565582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.565754] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.565848] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.565909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.566062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.566138] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.566222] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 936ed056-e8e6-49f2-9821-9d2c5ac3e7af is going to be updated. [ 1288.585134] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.585313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.585313] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.585478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.585606] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.585753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-936ed056-e8e6-49f2-9821-9d2c5ac3e7af" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.068484] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.570887] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.571520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.571520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.571520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.571646] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.571748] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb is going to be created. [ 1289.594761] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.594965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.594965] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.595169] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.595324] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.604424] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb in Status: UNINITIALIZED for 2s [ 1289.718159] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.718383] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.718428] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.718662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.718773] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.221268] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.723462] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.225730] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1291.225879] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1291.619386] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb in Status: UNINITIALIZED for 4s [ 1291.924798] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.925242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.925242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.925242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.938641] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1291.939518] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.940435] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1291.974795] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.974951] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.975038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.975263] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.988194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.989018] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1291.989128] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1291.989178] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1292.021595] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.021834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.021834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.022029] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.023396] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.023582] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1292.091909] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.092167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.092167] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.092338] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.092662] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.092938] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1292.164059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.164378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.164378] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.164521] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.164742] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.165073] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 1292.165173] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'5b44cf44-3516-4644-9659-498297843d9a', '4ee7fd9b-59b4-4423-847c-b926a3ab5883', 'f994c7a5-b3ac-4a57-b55b-a769c6119282', 'db110989-027c-4ed8-b5db-6b256912c344', 'd8019faa-8b2f-47fe-bceb-e7ffa5b64330', '6f61fdd6-c6dd-47e0-9456-36df63f208a2', '1c9b8f59-0fe1-4382-ad8c-018641195651', '3ee9bfb9-a909-4897-ba13-1c6476ab4ce8', '619cffb4-27cb-425f-bcd2-3f3b163886dc', '7b79f694-9d2b-4c43-8cea-cdc6e6ac940a', '0a07f521-fa55-49eb-99e1-95d44b468907', 'de490883-41da-4c7f-bed6-8ce11a434e5c', '5ab69c49-5404-4dd4-a6d3-4fce8969088a', 'dcaf011c-cc1f-4e0b-b169-b433df9cce25', '8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08', '6b917177-fad2-4a8d-bb56-2b4d47acad21', '9b49a7f5-6ed4-481f-81ba-d9ed36714c01', '4cb735ae-137c-4021-8f15-a132e8df5b1b', '552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b', '98c66d04-d431-433a-9b0a-4fec6e74caca', '8c3c5e73-32ea-4e2f-aecf-a8278a3549df', 'eea1ff77-b509-4f98-a878-bf09a64faa0e', '67b29187-e991-47a0-93b3-5a8f6f288242', '24d80c6b-3ebf-4ee6-8524-63b081da521b', '9141a736-220e-4a6b-b407-916c87c8099c', '153c5776-28ea-4b88-b692-fc1ee145e6dc', '89a039f0-af50-4be6-96e7-c2a3698d5144', '22d88dc5-1e20-4ce5-b224-a55bea6c2304', 'c5c29d6f-7489-45e1-8183-08f2d7095d33', 'ca7e639c-697c-438d-b550-983a53fa2d55', '0f73f976-0a71-450e-b4d0-b6746ce641e7', 'bab6e6dd-46c5-4ad0-add9-0acf4acd8ba9', 'a7dcf68e-77c7-4c96-8393-9ad6248f6c31', '5c2e75af-7b53-4662-af96-bb7c5bccaeba', 'cc82fdd2-2c0d-4c3e-9615-ce67612ddbd4', 'c37e051e-8989-4b52-b4f6-04f6b7301ee0', '549b1fb9-6c49-4106-8a22-052debb3b7f9', '83bed21a-0cd7-4bab-99c0-976f78b22b51', '64f4789b-3196-4067-98ab-735a7770f947', 'ab84161a-cc47-4bb7-8bc3-f695a8be1c0a', '4362ce77-85ac-42be-8249-4cf8afc1e957'} {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.165318] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1292.184443] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.184675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.184675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.184861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.184945] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.185073] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1292.185146] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.185218] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1292.254609] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.254850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.254850] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.255039] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.256164] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.256448] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1292.256531] env[63014]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=63014) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1292.256688] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1292.256688] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1292.256851] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 1292.256851] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGH for action security_group_rules [ 1292.256951] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGH for action security_group_rules [ 1292.256951] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGH for action security_group_rules [ 1292.257037] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGH for action security_group_rules [ 1292.257081] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGH for action security_group_rules [ 1292.257128] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGH for action security_group_rules [ 1292.257168] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGH for action security_group_rules [ 1292.257228] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGH for action security_group_rules [ 1292.257291] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGH for action security_group_rules [ 1292.257348] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGH for action security_group_rules [ 1292.257416] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGH for action security_group_rules [ 1292.257466] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGH for action security_group_rules [ 1292.257527] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGH for action security_group_rules [ 1292.257588] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGH for action security_group_rules [ 1292.257650] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGH for action security_group_rules [ 1292.257711] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGH for action security_group_rules [ 1292.257773] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGH for action security_group_rules [ 1292.257834] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGH for action security_group_rules [ 1292.257896] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGH for action security_group_rules [ 1292.257959] env[63014]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGH for action security_group_rules [ 1292.258066] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.057503] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.057869] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1293.057869] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b44cf44-3516-4644-9659-498297843d9a with Priority: HIGH for action security_group_rules [ 1293.057959] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 with Priority: HIGH for action security_group_rules [ 1293.057997] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 with Priority: HIGH for action security_group_rules [ 1293.058149] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 with Priority: HIGH for action security_group_rules [ 1293.058267] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98c66d04-d431-433a-9b0a-4fec6e74caca with Priority: HIGH for action security_group_rules [ 1293.058378] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b with Priority: HIGH for action security_group_rules [ 1293.058479] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b with Priority: HIGH for action security_group_rules [ 1293.058585] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 with Priority: HIGH for action security_group_rules [ 1293.058732] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 with Priority: HIGH for action security_group_rules [ 1293.058799] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 with Priority: HIGH for action security_group_rules [ 1293.058840] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a with Priority: HIGH for action security_group_rules [ 1293.058953] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de490883-41da-4c7f-bed6-8ce11a434e5c with Priority: HIGH for action security_group_rules [ 1293.059064] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a07f521-fa55-49eb-99e1-95d44b468907 with Priority: HIGH for action security_group_rules [ 1293.059170] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a with Priority: HIGH for action security_group_rules [ 1293.059262] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc with Priority: HIGH for action security_group_rules [ 1293.059357] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 with Priority: HIGH for action security_group_rules [ 1293.059449] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 with Priority: HIGH for action security_group_rules [ 1293.059534] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 with Priority: HIGH for action security_group_rules [ 1293.059631] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 with Priority: HIGH for action security_group_rules [ 1293.059728] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGH for action security_group_rules [ 1293.060073] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b44cf44-3516-4644-9659-498297843d9a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.060210] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.060283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.060591] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.060682] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b44cf44-3516-4644-9659-498297843d9a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.061739] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f994c7a5-b3ac-4a57-b55b-a769c6119282 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.061796] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.061876] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.062062] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.062138] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f994c7a5-b3ac-4a57-b55b-a769c6119282',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.063644] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c9b8f59-0fe1-4382-ad8c-018641195651 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.063817] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.063921] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.064180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.064283] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c9b8f59-0fe1-4382-ad8c-018641195651',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.065217] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.065374] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.065483] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.065702] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.065815] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.066784] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98c66d04-d431-433a-9b0a-4fec6e74caca taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.066856] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.066967] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.067196] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.067336] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98c66d04-d431-433a-9b0a-4fec6e74caca',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.068217] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.068391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.068490] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.068726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.068889] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.069740] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cb735ae-137c-4021-8f15-a132e8df5b1b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.069900] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.070033] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.070246] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.070366] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cb735ae-137c-4021-8f15-a132e8df5b1b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.071420] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.071593] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.071714] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.071950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.072085] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b49a7f5-6ed4-481f-81ba-d9ed36714c01',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.072996] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.073177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.073290] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.073523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.073644] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dcaf011c-cc1f-4e0b-b169-b433df9cce25',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.074564] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b917177-fad2-4a8d-bb56-2b4d47acad21 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.074730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.074842] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.075118] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.075179] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b917177-fad2-4a8d-bb56-2b4d47acad21',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.076253] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.076445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.076532] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.076751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.076938] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ab69c49-5404-4dd4-a6d3-4fce8969088a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.077791] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de490883-41da-4c7f-bed6-8ce11a434e5c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.077950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.078076] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.078316] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.078440] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de490883-41da-4c7f-bed6-8ce11a434e5c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.079377] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a07f521-fa55-49eb-99e1-95d44b468907 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.079550] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.079681] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.079897] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.080039] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a07f521-fa55-49eb-99e1-95d44b468907',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.080951] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.081143] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.081237] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.081453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.081574] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b79f694-9d2b-4c43-8cea-cdc6e6ac940a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.082631] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-619cffb4-27cb-425f-bcd2-3f3b163886dc taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.082803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.082910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.083153] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.083330] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('619cffb4-27cb-425f-bcd2-3f3b163886dc',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.084215] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.084502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.084502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.084693] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.084815] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f61fdd6-c6dd-47e0-9456-36df63f208a2',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.085711] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.085886] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.085985] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.086236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.086362] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ee9bfb9-a909-4897-ba13-1c6476ab4ce8',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.087275] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.087434] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.087613] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.087786] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.087876] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8019faa-8b2f-47fe-bceb-e7ffa5b64330',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.090250] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.090398] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.090472] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.090567] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.090636] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ee7fd9b-59b4-4423-847c-b926a3ab5883',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.091328] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.091421] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.091464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.091603] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.091669] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.118247] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.118453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.118453] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.118617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.120460] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.120583] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.121226] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.121323] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.122413] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.122506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.135115] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.135237] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ab69c49-5404-4dd4-a6d3-4fce8969088a is going to be deleted. [ 1293.136091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.136301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.153759] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.153913] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f994c7a5-b3ac-4a57-b55b-a769c6119282 is going to be deleted. [ 1293.154705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.154909] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.175624] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.175793] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08 is going to be deleted. [ 1293.176632] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.177923] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.179122] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.179309] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.191407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.191553] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b49a7f5-6ed4-481f-81ba-d9ed36714c01 is going to be deleted. [ 1293.192379] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.192608] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.192699] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.192815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ab69c49-5404-4dd4-a6d3-4fce8969088a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.200120] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.200266] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.200344] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.200530] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.200615] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.200726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f994c7a5-b3ac-4a57-b55b-a769c6119282" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.222198] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.222356] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.222412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.222625] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.222734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.222834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c55bfcb-2e07-4ff3-89b6-a4a96fa5ce08" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.239971] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.240206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.240206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.240471] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.240636] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.240791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b49a7f5-6ed4-481f-81ba-d9ed36714c01" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.615040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.615040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.615040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.615362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.615522] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.615656] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.615731] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.615881] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.615984] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.616110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.616230] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.643806] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.644020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.644020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.644247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.662056] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.662249] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.662973] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.663091] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.663970] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb in Status: SUCCESS [ 1293.664176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.664326] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.664524] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.664676] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.664783] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.664838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.664994] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.665092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.665177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.665265] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.670307] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.670445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.671113] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.671208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.674352] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.674445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.675499] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.675594] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.676351] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.676447] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.677133] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.677225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.677912] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.678012] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.678638] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1293.679081] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.679176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.679883] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1293.680292] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.680409] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.681089] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1293.681502] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.681611] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f61fdd6-c6dd-47e0-9456-36df63f208a2 is going to be deleted. [ 1293.683619] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.683713] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.683781] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.683972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.685337] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.685432] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.686011] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1293.686429] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.686528] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.704203] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1293.704694] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.704815] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b79f694-9d2b-4c43-8cea-cdc6e6ac940a is going to be deleted. [ 1293.705728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.705938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.724391] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.724521] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 619cffb4-27cb-425f-bcd2-3f3b163886dc is going to be deleted. [ 1293.725412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.725622] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.757180] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.757371] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.765686] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.765860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.768726] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.768885] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8019faa-8b2f-47fe-bceb-e7ffa5b64330 is going to be deleted. [ 1293.769709] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.769938] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.807984] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.808225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.813413] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.813535] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b917177-fad2-4a8d-bb56-2b4d47acad21 is going to be deleted. [ 1293.814492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.814718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.876119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.876268] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ee9bfb9-a909-4897-ba13-1c6476ab4ce8 is going to be deleted. [ 1293.877194] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.877427] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.878828] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.878932] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.901585] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.901761] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b is going to be deleted. [ 1293.902629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.902853] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.953443] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.953601] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.964277] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.964491] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a07f521-fa55-49eb-99e1-95d44b468907 is going to be deleted. [ 1293.965448] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.965721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.993619] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.993760] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cb735ae-137c-4021-8f15-a132e8df5b1b is going to be deleted. [ 1293.994649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.994865] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.090791] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.091225] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.103517] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.103693] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de490883-41da-4c7f-bed6-8ce11a434e5c is going to be deleted. [ 1294.104557] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.104778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.106408] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.106531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.121440] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.130668] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.130820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.167315] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.192721] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.192894] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98c66d04-d431-433a-9b0a-4fec6e74caca is going to be deleted. [ 1294.194124] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.194400] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.213402] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.213597] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.231117] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.231266] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c9b8f59-0fe1-4382-ad8c-018641195651 is going to be deleted. [ 1294.232258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.232481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.283437] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.283604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.326484] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.326690] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.338454] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.338615] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ee7fd9b-59b4-4423-847c-b926a3ab5883 is going to be deleted. [ 1294.339535] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.339745] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.382016] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.382251] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b44cf44-3516-4644-9659-498297843d9a is going to be deleted. [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dcaf011c-cc1f-4e0b-b169-b433df9cce25 is going to be deleted. [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f61fdd6-c6dd-47e0-9456-36df63f208a2" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c9b8f59-0fe1-4382-ad8c-018641195651" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b79f694-9d2b-4c43-8cea-cdc6e6ac940a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-619cffb4-27cb-425f-bcd2-3f3b163886dc" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.459929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8019faa-8b2f-47fe-bceb-e7ffa5b64330" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b917177-fad2-4a8d-bb56-2b4d47acad21" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ee9bfb9-a909-4897-ba13-1c6476ab4ce8" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-552d9cb0-6d18-41e1-91c4-ab6ad95c8c3b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a07f521-fa55-49eb-99e1-95d44b468907" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cb735ae-137c-4021-8f15-a132e8df5b1b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.460979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de490883-41da-4c7f-bed6-8ce11a434e5c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.461981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.461981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.461981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.461981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98c66d04-d431-433a-9b0a-4fec6e74caca" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.474059] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.474236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.474280] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.474459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.474582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.474779] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ee7fd9b-59b4-4423-847c-b926a3ab5883" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.623613] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db110989-027c-4ed8-b5db-6b256912c344: rpc.has_security_group_logging(os_id): False [ 1294.625493] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.625630] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.625696] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.625919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.626015] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.626134] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b44cf44-3516-4644-9659-498297843d9a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.669010] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c81574f-ed38-45ed-b9ab-6228b9f22efb: rpc.has_security_group_logging(os_id): False [ 1294.675901] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.676112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.676112] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.676335] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.689912] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.690111] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.718624] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.718827] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.741176] env[63014]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1294.741763] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.742071] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.742190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.742247] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.742441] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.742523] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.742624] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1294.743638] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.743811] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.743895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.744008] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dcaf011c-cc1f-4e0b-b169-b433df9cce25" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.744141] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.744283] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.744360] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.744579] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.744683] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.744744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.744884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.744958] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.745053] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb is going to be created. [ 1294.883317] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.883570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.883570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.883732] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.883911] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.912204] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.912443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.912443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.912590] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.912747] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.931541] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb in Status: IN_PROGRESS for 2s [ 1295.009534] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1296.944395] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb in Status: SUCCESS [ 1296.944752] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.022364] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1297.022545] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.061349] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.061349] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.062025] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.062331] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.773813] env[63014]: INFO networking_nsxv3.common.synchronization [req-647470d5-8a10-40b5-8315-8488b7b9a9e9 req-b48b6467-dba8-45b3-8561-398fe0e7184c tempest-ServerActionsTestJSON-453576680 tempest-ServerActionsTestJSON-453576680-project-member] Enqueued Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1307.774574] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9141a736-220e-4a6b-b407-916c87c8099c with Priority: HIGHEST for action security_group_members [ 1307.775017] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9141a736-220e-4a6b-b407-916c87c8099c taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.775224] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.775369] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.775637] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.775904] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.776110] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.776231] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.776475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.776621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.776742] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9141a736-220e-4a6b-b407-916c87c8099c',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.281024] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.281024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.281024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.281024] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.301174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.301174] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.301174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.301174] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.301560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.301560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.301560] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c is going to be updated. [ 1308.324125] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.324270] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.324355] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.324482] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.324617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.331429] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: IN_PROGRESS for 2s [ 1310.344756] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9141a736-220e-4a6b-b407-916c87c8099c in Status: SUCCESS [ 1310.344756] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9141a736-220e-4a6b-b407-916c87c8099c deletion is rescheduled due to dependency. [ 1310.344756] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9141a736-220e-4a6b-b407-916c87c8099c" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.775307] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1312.775609] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.255586] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.255801] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.255929] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.256249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.256517] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.256683] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.256808] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.257166] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.257345] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.257560] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.257678] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1313.257794] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1313.257905] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1313.258028] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1313.258143] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1313.258282] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1313.276821] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1313.276969] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1313.277129] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1313.277298] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-166" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.277583] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-11435eed-984e-4e61-8df9-637c3b31098f taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.277751] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.277876] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.278144] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.278284] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11435eed-984e-4e61-8df9-637c3b31098f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.781079] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.781475] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.781475] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.781684] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.781886] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.782155] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.782316] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.782438] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.782659] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.782803] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.783147] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.783314] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.783452] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.783667] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.783807] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.783954] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 11435eed-984e-4e61-8df9-637c3b31098f is going to be updated. [ 1313.805101] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.805372] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.805446] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.805709] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.805911] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.806150] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.472642] env[63014]: INFO networking_nsxv3.common.synchronization [req-47501a11-8f58-490d-9a0d-ff58cd073583 req-5cb1c8d5-e46a-4085-aa83-e9e0e31302e0 service nova] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 1314.472838] env[63014]: INFO networking_nsxv3.common.synchronization [req-47501a11-8f58-490d-9a0d-ff58cd073583 req-5cb1c8d5-e46a-4085-aa83-e9e0e31302e0 service nova] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1314.472988] env[63014]: INFO networking_nsxv3.common.synchronization [req-47501a11-8f58-490d-9a0d-ff58cd073583 req-5cb1c8d5-e46a-4085-aa83-e9e0e31302e0 service nova] Enqueued Resource ID: 11435eed-984e-4e61-8df9-637c3b31098f with Priority: HIGHEST for action port [ 1314.473238] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_rules [ 1314.473382] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1314.473480] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11435eed-984e-4e61-8df9-637c3b31098f with Priority: HIGHEST for action port [ 1314.474242] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.474407] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.474520] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.474791] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.474940] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.477209] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.477209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.477209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.477209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.477209] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.477209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.477209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.477209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.477209] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.477209] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.478029] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-11435eed-984e-4e61-8df9-637c3b31098f taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.478607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.478607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.478607] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.478607] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11435eed-984e-4e61-8df9-637c3b31098f',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.980149] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.980554] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.980554] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.981422] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 11435eed-984e-4e61-8df9-637c3b31098f with status ACTIVE [ 1314.981647] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.981774] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.981838] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.982036] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.982132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.982314] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.982412] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.982478] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.982626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.982705] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.982886] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.982978] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.983509] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.983695] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.983775] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.983869] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 11435eed-984e-4e61-8df9-637c3b31098f is going to be updated. [ 1315.004221] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.004352] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.004420] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.004617] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.004750] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.004905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11435eed-984e-4e61-8df9-637c3b31098f" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.486499] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.989587] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.990067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.990067] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.990206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.990282] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.990413] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1316.018201] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.018500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.018500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.018753] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.018920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.030226] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1318.041482] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1318.041893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.041893] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.042150] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.042347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.042533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.042533] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.042730] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.042823] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.042912] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.043341] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.546229] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.049156] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db110989-027c-4ed8-b5db-6b256912c344: rpc.has_security_group_logging(os_id): False [ 1319.082573] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.082815] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.082866] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.083301] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.083475] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.083837] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.084040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.084116] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.084357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.084425] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.084518] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1319.160579] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.160807] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.160950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.161201] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.161357] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.190391] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1319.474222] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.474408] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1321.209415] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1321.209814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.475777] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.476202] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.477326] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.477715] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1331.288267] env[63014]: INFO networking_nsxv3.common.synchronization [req-b4665ea3-0b69-4f90-8c20-45a32b580382 req-b5572eb4-855a-46e1-9a50-1ff1e714b315 tempest-ServerActionsTestOtherB-7425835 tempest-ServerActionsTestOtherB-7425835-project-member] Enqueued Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1331.288267] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db110989-027c-4ed8-b5db-6b256912c344 with Priority: HIGHEST for action security_group_members [ 1331.288267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-db110989-027c-4ed8-b5db-6b256912c344 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.288267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.288267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.288267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.288267] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.288267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.288267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.288751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.288751] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.288751] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db110989-027c-4ed8-b5db-6b256912c344',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.791211] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.791390] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.791446] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.791626] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.791716] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.791937] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.792063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.792133] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.792275] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.792354] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.792443] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 is going to be updated. [ 1331.818759] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.818919] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.818971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.819152] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.819291] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.826143] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: IN_PROGRESS for 2s [ 1333.836216] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db110989-027c-4ed8-b5db-6b256912c344 in Status: SUCCESS [ 1333.836525] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db110989-027c-4ed8-b5db-6b256912c344 deletion is rescheduled due to dependency. [ 1333.836525] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db110989-027c-4ed8-b5db-6b256912c344" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.288179] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.288586] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.289256] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.289583] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.678488] env[63014]: INFO networking_nsxv3.common.synchronization [None req-83a5a6dc-0897-4ee4-be86-a07f147406ae None None] Enqueued Resource ID: 99a74038-aa6a-424b-9e12-b5807b117e6b with Priority: HIGHEST for action port [ 1342.679177] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99a74038-aa6a-424b-9e12-b5807b117e6b with Priority: HIGHEST for action port [ 1342.679486] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-99a74038-aa6a-424b-9e12-b5807b117e6b taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.679621] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99a74038-aa6a-424b-9e12-b5807b117e6b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.679687] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99a74038-aa6a-424b-9e12-b5807b117e6b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.679950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99a74038-aa6a-424b-9e12-b5807b117e6b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.680311] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99a74038-aa6a-424b-9e12-b5807b117e6b',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.184302] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99a74038-aa6a-424b-9e12-b5807b117e6b [ 1343.184544] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.184679] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.184749] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.184966] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.185074] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.185172] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99a74038-aa6a-424b-9e12-b5807b117e6b already deleted. [ 1343.185256] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99a74038-aa6a-424b-9e12-b5807b117e6b" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.509907] env[63014]: INFO networking_nsxv3.common.synchronization [None req-558b171d-e7c8-4125-aa85-52cf8b1c85b2 None None] Enqueued Resource ID: 28512ccf-e7eb-47f4-a5b3-c7333e5f2736 with Priority: HIGHEST for action port [ 1344.510192] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28512ccf-e7eb-47f4-a5b3-c7333e5f2736 with Priority: HIGHEST for action port [ 1344.510755] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-28512ccf-e7eb-47f4-a5b3-c7333e5f2736 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.510882] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28512ccf-e7eb-47f4-a5b3-c7333e5f2736" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.510950] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28512ccf-e7eb-47f4-a5b3-c7333e5f2736" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.511248] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28512ccf-e7eb-47f4-a5b3-c7333e5f2736" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.511329] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28512ccf-e7eb-47f4-a5b3-c7333e5f2736',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.013286] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28512ccf-e7eb-47f4-a5b3-c7333e5f2736 [ 1345.013613] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.013744] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.013814] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.014037] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.014132] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.014226] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28512ccf-e7eb-47f4-a5b3-c7333e5f2736 already deleted. [ 1345.014305] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28512ccf-e7eb-47f4-a5b3-c7333e5f2736" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.784591] env[63014]: INFO networking_nsxv3.common.synchronization [req-b4089422-50f1-4e59-b813-00b29ee1017c req-88f28564-432a-4013-b18c-4951f0301b64 tempest-ServerMetadataTestJSON-462993160 tempest-ServerMetadataTestJSON-462993160-project-member] Enqueued Resource ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba with Priority: HIGHEST for action security_group_members [ 1347.785239] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba with Priority: HIGHEST for action security_group_members [ 1347.785589] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.785770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.785873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.786190] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.786402] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.786553] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.786666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.786884] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.787020] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.787176] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.045673] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.045925] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-801" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.046110] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-801" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.046463] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-801" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.046735] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.046902] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.047035] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.047256] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.047406] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.047629] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1348.047746] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1348.047857] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1348.047968] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1348.048094] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1348.048206] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1348.048341] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1348.066868] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1348.067040] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1348.067179] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1348.067348] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-801" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.067614] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-91199316-483c-4d67-84d6-3cdfde28e62a taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.067773] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-91199316-483c-4d67-84d6-3cdfde28e62a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.067896] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-91199316-483c-4d67-84d6-3cdfde28e62a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.068192] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-91199316-483c-4d67-84d6-3cdfde28e62a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.068385] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91199316-483c-4d67-84d6-3cdfde28e62a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.290040] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.290040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.290040] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.290233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.290233] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.290415] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.290516] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.290576] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.290728] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.290806] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.290894] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba already deleted. [ 1348.290977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.570906] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.570906] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.570906] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.571242] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.571630] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.571630] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 91199316-483c-4d67-84d6-3cdfde28e62a not found, creating... [ 1348.571982] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.572169] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.572745] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.573053] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.573130] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.573627] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.574249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.574249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.574249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.574361] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.574462] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 91199316-483c-4d67-84d6-3cdfde28e62a is going to be created. [ 1348.593931] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.594196] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.594334] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.594589] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.594814] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.595059] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-91199316-483c-4d67-84d6-3cdfde28e62a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.275216] env[63014]: INFO networking_nsxv3.common.synchronization [req-b4089422-50f1-4e59-b813-00b29ee1017c req-dab1b06e-c5c5-4153-b232-6b31a124257d service nova] Enqueued Resource ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba with Priority: HIGHEST for action security_group_rules [ 1349.275216] env[63014]: INFO networking_nsxv3.common.synchronization [req-b4089422-50f1-4e59-b813-00b29ee1017c req-dab1b06e-c5c5-4153-b232-6b31a124257d service nova] Enqueued Resource ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba with Priority: HIGHEST for action security_group_members [ 1349.275216] env[63014]: INFO networking_nsxv3.common.synchronization [req-b4089422-50f1-4e59-b813-00b29ee1017c req-dab1b06e-c5c5-4153-b232-6b31a124257d service nova] Enqueued Resource ID: 91199316-483c-4d67-84d6-3cdfde28e62a with Priority: HIGHEST for action port [ 1349.275216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba with Priority: HIGHEST for action security_group_rules [ 1349.275216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba with Priority: HIGHEST for action security_group_members [ 1349.275216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91199316-483c-4d67-84d6-3cdfde28e62a with Priority: HIGHEST for action port [ 1349.275216] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.275216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.275216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.276314] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.276545] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.277575] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.277830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.278017] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.278312] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.278569] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.278792] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.278964] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.279267] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.279481] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.279676] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.280849] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-91199316-483c-4d67-84d6-3cdfde28e62a taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.280849] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91199316-483c-4d67-84d6-3cdfde28e62a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.280960] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91199316-483c-4d67-84d6-3cdfde28e62a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.281119] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91199316-483c-4d67-84d6-3cdfde28e62a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.281190] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91199316-483c-4d67-84d6-3cdfde28e62a',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.782532] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.783864] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.784038] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.784312] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91199316-483c-4d67-84d6-3cdfde28e62a with status ACTIVE [ 1349.784567] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.784727] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.784831] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.785151] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.785285] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.785495] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.786511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.786511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.786511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.786511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.786511] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.786511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.786511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.786511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.786511] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.786511] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91199316-483c-4d67-84d6-3cdfde28e62a is going to be updated. [ 1349.807361] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.807507] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.807599] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.807773] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.807878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.808032] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91199316-483c-4d67-84d6-3cdfde28e62a" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.288901] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.692928] env[63014]: INFO networking_nsxv3.common.synchronization [req-904e3103-a79d-4413-8f0e-72ad2ebe59d2 req-78c3f151-5621-4077-8f16-37043ec323ab tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_members [ 1350.693370] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb with Priority: HIGHEST for action security_group_members [ 1350.693700] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c81574f-ed38-45ed-b9ab-6228b9f22efb taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.693852] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.693933] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.694506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.694506] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.694506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.694506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.695242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.695242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.695242] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c81574f-ed38-45ed-b9ab-6228b9f22efb',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.792788] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.792788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.792788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.792788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.792788] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.792788] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba is going to be created. [ 1350.817347] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.817347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.817347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.817347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.817347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.825298] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba in Status: UNINITIALIZED for 2s [ 1351.197284] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.197505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.197505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.197737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.197830] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.198051] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.198158] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.198211] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.198366] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.198443] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.198528] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb is going to be updated. [ 1351.224365] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.224500] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.224570] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.224760] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.224895] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.233282] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb in Status: IN_PROGRESS for 2s [ 1352.834740] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba in Status: SUCCESS [ 1352.835061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.835061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.835242] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.835425] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.835538] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.835604] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.835755] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.835834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.835920] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.836018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.241940] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb in Status: SUCCESS [ 1353.242128] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c81574f-ed38-45ed-b9ab-6228b9f22efb deletion is rescheduled due to dependency. [ 1353.242258] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c81574f-ed38-45ed-b9ab-6228b9f22efb" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.338085] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.338346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.338346] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.338552] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.338666] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.338765] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.338846] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.338971] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.339064] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.339217] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.339379] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.339466] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.339531] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.339678] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.339820] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.339910] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.339979] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.340130] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.340208] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.340284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.340374] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1353.842586] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba: rpc.has_security_group_logging(os_id): False [ 1353.860493] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.860649] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.860737] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.860949] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.861053] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.861346] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.861499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.861586] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.861793] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.861907] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.862206] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.862362] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.862464] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.862598] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.862758] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.862869] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.862977] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.863045] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.863176] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.863255] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.863341] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba is going to be created. [ 1353.925437] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.925560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.925560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.925720] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.925896] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.934601] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba in Status: IN_PROGRESS for 2s [ 1355.189531] env[63014]: INFO networking_nsxv3.common.synchronization [None req-945f8c4e-92d2-4312-b052-52858228218d tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_rules [ 1355.190216] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_rules [ 1355.190316] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92b5b113-087f-4732-a90f-43b3383950d3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.190445] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.190499] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.190799] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.190880] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.293248] env[63014]: INFO networking_nsxv3.common.synchronization [None req-6fbb97a8-8a48-48bc-bfe1-6b57906a724a tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_rules [ 1355.293968] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_rules [ 1355.294370] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92b5b113-087f-4732-a90f-43b3383950d3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.294479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.712312] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.712506] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.712660] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.712930] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.713061] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.713200] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92b5b113-087f-4732-a90f-43b3383950d3 already deleted. [ 1355.713347] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.713610] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.713878] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.714018] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.945986] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba in Status: SUCCESS [ 1355.946296] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.235045] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.235459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.235459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.235459] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.235609] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.235673] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92b5b113-087f-4732-a90f-43b3383950d3 already deleted. [ 1356.235734] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.778992] env[63014]: INFO networking_nsxv3.common.synchronization [req-92470f21-1d36-4255-95d1-d3c930affe82 req-37153d65-3495-4589-9c58-2cfa37afa47e tempest-ServerMetadataTestJSON-462993160 tempest-ServerMetadataTestJSON-462993160-project-member] Enqueued Resource ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba with Priority: HIGHEST for action security_group_members [ 1359.780167] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba with Priority: HIGHEST for action security_group_members [ 1359.780326] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.780512] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.780629] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.780905] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.781156] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.781325] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.781429] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.781674] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.781812] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.781994] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.284143] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.284329] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.284373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.284579] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.284675] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.284872] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.284972] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.285051] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.285206] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.285284] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.285374] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba is going to be updated. [ 1360.312560] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.312560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.312560] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.312761] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.312861] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.321057] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba in Status: IN_PROGRESS for 2s [ 1360.591351] env[63014]: INFO networking_nsxv3.common.synchronization [req-5c097e07-3043-402d-bc1c-2330abdd4501 req-482e3987-06d4-4845-839d-bad565a38850 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_members [ 1360.591996] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_members [ 1360.592397] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b5b113-087f-4732-a90f-43b3383950d3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.592556] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.592648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.592939] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.593142] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.593279] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.593370] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.593569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.593692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.593824] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.994554] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.994839] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.994947] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.995240] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.995507] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.995674] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.995799] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.996027] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.996182] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.996395] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.996518] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] NeedRegenerationException {{(pid=63014) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1360.996699] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] no value, waiting for create lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1360.996835] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] value creation lock acquired {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1360.996960] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] No value present for key: 'zone-id' {{(pid=63014) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1360.997087] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Calling creation function for not-yet-present value {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1360.997230] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1361.013786] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1361.013931] env[63014]: DEBUG dogpile.cache.region [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=63014) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1361.014083] env[63014]: DEBUG dogpile.lock [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Released creation lock {{(pid=63014) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1361.014249] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "network-740" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.014512] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock port-8b47a737-e56c-4575-8fd5-f02b2ee17087 taken with stack trace [, , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.014672] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "port-8b47a737-e56c-4575-8fd5-f02b2ee17087" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.014795] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "port-8b47a737-e56c-4575-8fd5-f02b2ee17087" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.015091] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "port-8b47a737-e56c-4575-8fd5-f02b2ee17087" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.015236] env[63014]: DEBUG networking_nsxv3.api.rpc [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b47a737-e56c-4575-8fd5-f02b2ee17087',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.095908] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.096092] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.096136] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.096367] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.096463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.096658] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.096766] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.096828] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.096981] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.097080] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.097168] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92b5b113-087f-4732-a90f-43b3383950d3 already deleted. [ 1361.097250] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.517177] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.517425] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.517599] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.517898] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.518075] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.518244] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Segment Port 8b47a737-e56c-4575-8fd5-f02b2ee17087 not found, creating... [ 1361.518510] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.518679] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.518804] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.519056] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.519319] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.519630] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.519796] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.519921] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.520158] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.520301] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.520456] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Resource: SegmentPort with ID: 8b47a737-e56c-4575-8fd5-f02b2ee17087 is going to be created. [ 1361.540060] env[63014]: DEBUG networking_nsxv3.common.locking [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.540226] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.540226] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.540495] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.540747] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.540985] env[63014]: DEBUG oslo_concurrency.lockutils [None req-8221194b-e2b7-4f70-9c9b-c107e4f9002f None None] Releasing lock "port-8b47a737-e56c-4575-8fd5-f02b2ee17087" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.221340] env[63014]: INFO networking_nsxv3.common.synchronization [req-5c097e07-3043-402d-bc1c-2330abdd4501 req-958897e5-3539-4bae-8953-731c39a6515e service nova] Enqueued Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_rules [ 1362.221593] env[63014]: INFO networking_nsxv3.common.synchronization [req-5c097e07-3043-402d-bc1c-2330abdd4501 req-958897e5-3539-4bae-8953-731c39a6515e service nova] Enqueued Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_members [ 1362.221696] env[63014]: INFO networking_nsxv3.common.synchronization [req-5c097e07-3043-402d-bc1c-2330abdd4501 req-958897e5-3539-4bae-8953-731c39a6515e service nova] Enqueued Resource ID: 8b47a737-e56c-4575-8fd5-f02b2ee17087 with Priority: HIGHEST for action port [ 1362.221922] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_rules [ 1362.222067] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_members [ 1362.222179] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b47a737-e56c-4575-8fd5-f02b2ee17087 with Priority: HIGHEST for action port [ 1362.222742] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92b5b113-087f-4732-a90f-43b3383950d3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.222870] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.222942] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.223254] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.223400] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.224274] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b5b113-087f-4732-a90f-43b3383950d3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.224479] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.224582] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.224778] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.224988] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.225114] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.225205] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.225382] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.225505] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.225646] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.227910] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b47a737-e56c-4575-8fd5-f02b2ee17087 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.228077] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b47a737-e56c-4575-8fd5-f02b2ee17087" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.228180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b47a737-e56c-4575-8fd5-f02b2ee17087" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.228359] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b47a737-e56c-4575-8fd5-f02b2ee17087" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.228471] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b47a737-e56c-4575-8fd5-f02b2ee17087',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.330426] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba in Status: SUCCESS [ 1362.330645] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba deletion is rescheduled due to dependency. [ 1362.330808] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9474e1b4-03d6-41f3-b17e-e0e9e9ac86ba" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.730067] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b5b113-087f-4732-a90f-43b3383950d3 taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.730268] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.730461] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.731353] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b47a737-e56c-4575-8fd5-f02b2ee17087 with status ACTIVE [ 1362.731540] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.731652] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.731719] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.731925] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.732983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.732983] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.732983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.732983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.732983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.732983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.732983] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.732983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.732983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.732983] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.734330] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.734330] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b47a737-e56c-4575-8fd5-f02b2ee17087 is going to be updated. [ 1362.753511] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.753666] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.753784] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.754009] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.754185] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.754373] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b47a737-e56c-4575-8fd5-f02b2ee17087" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.235151] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.737257] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.737452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.737496] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.737717] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.737771] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.737868] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92b5b113-087f-4732-a90f-43b3383950d3 is going to be created. [ 1363.759681] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.759820] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.759860] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.760044] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.760216] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.769449] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92b5b113-087f-4732-a90f-43b3383950d3 in Status: UNINITIALIZED for 2s [ 1365.781608] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92b5b113-087f-4732-a90f-43b3383950d3 in Status: SUCCESS [ 1365.781929] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.782073] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.782289] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.782521] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.782644] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.782707] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.782873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.782956] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.783063] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.783154] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.286016] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.788991] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92b5b113-087f-4732-a90f-43b3383950d3: rpc.has_security_group_logging(os_id): False [ 1366.809688] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.809872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.809914] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.810177] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.810269] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.810519] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.810648] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.810718] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.810880] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.810961] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.811184] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92b5b113-087f-4732-a90f-43b3383950d3 is going to be created. [ 1366.874278] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.874452] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.874495] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.874692] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.874873] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.885272] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92b5b113-087f-4732-a90f-43b3383950d3 in Status: IN_PROGRESS for 2s [ 1367.223200] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.223418] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1368.900551] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92b5b113-087f-4732-a90f-43b3383950d3 in Status: SUCCESS [ 1368.900834] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.224933] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.224933] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.225737] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.225737] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.226699] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.227406] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.228585] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.228585] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.229638] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.229995] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.231050] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.231282] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.232422] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.232799] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.234107] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.234488] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.235330] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.235719] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.236919] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.236919] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1422.238321] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1422.238321] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.347230] env[63014]: INFO networking_nsxv3.common.synchronization [req-10b20658-3407-4053-b15c-10a6a298ee94 req-cf4092ad-25d2-437f-bc1f-c1b0eca0d8c1 tempest-AttachVolumeNegativeTest-423363950 tempest-AttachVolumeNegativeTest-423363950-project-member] Enqueued Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_members [ 1423.347777] env[63014]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b5b113-087f-4732-a90f-43b3383950d3 with Priority: HIGHEST for action security_group_members [ 1423.348102] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock member-92b5b113-087f-4732-a90f-43b3383950d3 taken with stack trace [, , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.348236] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.348304] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.349332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.349332] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.349332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.349332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.349332] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.349664] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.349664] env[63014]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92b5b113-087f-4732-a90f-43b3383950d3',) {} {{(pid=63014) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1423.853342] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.853492] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.853569] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.853780] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.853872] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.854078] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.854180] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.854241] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.854388] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.854463] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.854549] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92b5b113-087f-4732-a90f-43b3383950d3 is going to be updated. [ 1423.892117] env[63014]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=63014) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1423.892339] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1423.892461] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1423.892770] env[63014]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1423.893028] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1423.901691] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92b5b113-087f-4732-a90f-43b3383950d3 in Status: IN_PROGRESS for 2s [ 1425.912477] env[63014]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92b5b113-087f-4732-a90f-43b3383950d3 in Status: SUCCESS [ 1425.912732] env[63014]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92b5b113-087f-4732-a90f-43b3383950d3 deletion is rescheduled due to dependency. [ 1425.912803] env[63014]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92b5b113-087f-4732-a90f-43b3383950d3" {{(pid=63014) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1428.348680] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.348680] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.349568] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.349911] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.351204] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.351628] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.352366] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.352782] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.353575] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.353972] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.355215] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.355859] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.357232] env[63014]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.357574] env[63014]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0